00000001:02000400:2.0F:1787599138.860745:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787599156.994567:0:3521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787599158.873288:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 579 MB/s 00000001:01000000:0.0F:1787599159.123979:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 776 MB/s 00000001:01000000:2.0:1787599159.374495:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4203 MB/s 00000020:02000000:0.0:1787599160.096409:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g20f51fc 00000400:02000000:2.0:1787599161.195112:0:3629:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.101@tcp [8/256/0/180] 00008000:02000000:0.0:1787599165.200750:0:3778:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787599230.661432:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787599245.351448:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787599245.351823:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787599245.351825:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787599245.353089:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000091dfa032 00000080:02000400:1.0:1787599245.353105:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787599245.369626:0:6497:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787599245.369642:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787599245.369682:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000faadd550) 00000020:00000080:1.0:1787599245.369703:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787599245.501539:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787599245.501608:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787599245.528242:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787599245.528482:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787599245.528491:0:6497:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787599245.528502:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cedc7 00000020:01000004:3.0:1787599245.528508:0:6497:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787599245.528512:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787599245.528516:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000091dfa032 from MGS 00000020:01000004:3.0:1787599245.528520:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787599245.528538:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007984fe65) 00000020:00000080:3.0:1787599245.528549:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787599245.528654:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000091dfa032 from MGS, refs=2 00080000:01000000:3.0:1787599245.528659:0:6497:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787599245.528666:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cedd5 00000100:00100000:3.0:1787599245.528903:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787599245.529036:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787599245.529041:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787599245.530601:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787599245.530614:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787599245.532743:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599245.533773:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787599245.533781:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787599245.536088:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787599245.536103:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787599245.542549:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787599245.542642:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787599245.544263:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599245.544268:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599245.544270:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599245.544691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599245.544693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599245.544695:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599245.545530:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787599245.547281:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787599245.798331:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2549 MB/s 00000001:01000000:3.0:1787599246.047889:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2427 MB/s 00000001:01000000:3.0:1787599246.299012:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 422 MB/s 00000001:01000000:2.0:1787599246.555137:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 593 MB/s 00080000:10000000:3.0:1787599246.563903:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1787599246.567832:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787599246.584350:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787599246.587098:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787599246.587694:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787599246.587835:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787599246.588069:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787599246.588094:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787599246.588425:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599246.588578:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787599246.588584:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787599246.599699:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787599246.599728:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787599246.600287:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787599246.600294:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787599246.600955:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787599246.600976:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:2.0:1787599246.600978:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787599246.601022:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:2.0:1787599246.601044:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (00000000718636c8) 00000020:00000080:2.0:1787599246.601072:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787599246.601184:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000592d97d8@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599246.601381:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:2.0:1787599246.601388:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787599246.601865:0:6516:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787599246.603630:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787599246.603675:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 06cde0c1-6e67-4be0-92c4-a9f33549d8e6) 00000020:00000080:0.0:1787599246.603698:0:6497:0:(genops.c:1385:class_connect()) connect: client 06cde0c1-6e67-4be0-92c4-a9f33549d8e6, cookie 0x5d2988b0929cede3 00000100:00080000:0.0:1787599246.603720:0:6497:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599246.603725:0:6497:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import 00000000592d97d8 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599246.603765:0:6497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000425b251a x1874433577844864/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599246.603816:0:6497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS 00000020:01000004:0.0:1787599246.603833:0:6497:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787599246.603838:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787599246.603858:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e2a25e97) 00000020:00000080:0.0:1787599246.603871:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787599246.605497:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000425b251a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433577844864:0@lo:250: 00000100:00100000:3.0:1787599246.608718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.612847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577844864 00000100:00100000:1.0:1787599246.612866:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577844864 00000100:00100000:1.0:1787599246.612917:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599246.612924:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d58cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1874433577844864:12345-0@lo:250: 00010000:00080000:1.0:1787599246.612951:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 06cde0c1-6e67-4be0-92c4-a9f33549d8e6@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1787599246.612981:0:6512:0:(genops.c:1385:class_connect()) connect: client 06cde0c1-6e67-4be0-92c4-a9f33549d8e6, cookie 0x5d2988b0929cedf1 00000100:00080000:1.0:1787599246.613113:0:6512:0:(import.c:65:import_set_state_nolock()) 000000000feaf899 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599246.613203:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d58cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:3644:x1874433577844864:12345-0@lo:250: Request processed in 278us (4501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599246.613210:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599246.619000:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787599246.619015:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:3.0:1787599246.619024:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787599246.619030:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787599246.619033:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000592d97d8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787599246.619037:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787599246.619093:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787599246.619102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000425b251a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433577844864:0@lo:250: 00000100:00100000:0.0:1787599246.636498:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599246.636764:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787599246.636772:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787599246.638756:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599246.638780:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787599246.639455:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787599246.639462:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787599246.640554:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599246.642180:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787599246.642192:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787599246.643592:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787599246.643603:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787599246.714290:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599246.714499:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787599246.714506:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787599246.719154:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787599246.719170:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787599246.720892:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599246.721524:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599246.721534:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787599246.723537:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599246.723557:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787599246.738588:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599246.738850:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787599246.739042:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787599246.740443:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599246.740464:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787599246.742075:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599246.745292:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599246.745303:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787599246.748543:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599246.748557:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787599246.784831:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599246.787546:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787599246.787555:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787599246.790822:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599246.790846:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787599246.805671:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787599246.805695:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787599246.809542:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787599246.809683:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787599246.809691:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787599246.810212:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787599246.810269:0:6497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787599246.810273:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787599246.810278:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787599246.810280:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599246.810281:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599246.810282:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599246.810283:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599246.810284:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599246.810286:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787599246.810287:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787599246.810288:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787599246.810289:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599246.810290:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787599246.810292:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787599246.810294:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787599246.810295:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787599246.810296:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599246.810297:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599246.810298:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599246.810299:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599246.810300:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599246.810300:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787599246.810301:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787599246.810302:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787599246.810302:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599246.810303:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787599246.810343:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787599246.810362:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577844992:0@lo:253: 00000100:00100000:1.0:1787599246.810444:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.810543:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b9e3dd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787599246.810635:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577844992 00000100:00100000:0.0:1787599246.810645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577844992 00000100:00100000:0.0:1787599246.810746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599246.810756:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062210fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6497:x1874433577844992:12345-0@lo:253: 20000000:01000000:0.0:1787599246.810863:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787599246.810866:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787599246.811492:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787599246.811548:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787599246.811887:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599246.813736:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787599246.814200:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787599246.814205:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787599246.814211:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787599246.814214:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787599246.814226:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787599246.814421:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599246.814619:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787599246.814635:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787599246.814652:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787599246.814668:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787599246.814681:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787599246.814733:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787599246.814741:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787599246.814754:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787599246.814767:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787599246.814781:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787599246.814786:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787599246.816177:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787599246.816209:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787599246.816266:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787599246.816273:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787599246.816282:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599246.816474:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787599246.816486:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787599246.816501:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787599246.816515:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787599246.816531:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787599246.816539:0:6515:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787599246.816563:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787599246.816570:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787599246.816580:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787599246.816593:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787599246.816605:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787599246.816612:0:6515:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787599246.816634:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787599246.816641:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787599246.816652:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787599246.816667:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787599246.816733:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787599246.816754:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787599246.819099:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787599246.827323:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787599246.827544:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787599246.827570:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:2.0:1787599246.827572:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787599246.827585:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787599246.827589:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787599246.827599:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787599246.827603:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1787599246.827612:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787599246.827618:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787599246.827628:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787599246.827639:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787599246.827662:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787599246.827666:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787599246.827670:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787599246.827724:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787599246.827727:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599246.828356:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787599246.828528:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787599246.828548:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787599246.828563:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787599246.828572:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787599246.828573:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599246.830323:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787599246.830539:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787599246.830565:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787599246.830580:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787599246.830590:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599246.830592:0:6515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787599246.830597:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787599246.830600:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787599246.830605:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787599246.830610:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787599246.831334:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787599246.831442:0:6515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787599246.843405:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787599246.843448:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787599246.843464:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787599246.843489:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787599246.843515:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843534:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843555:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843561:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843567:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843573:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843579:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000970d1b1e already unused, calling callback (000000009558233a) 00010000:00010000:3.0:1787599246.843582:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843589:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843602:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843609:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.843614:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cedf8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599246.843634:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787599246.856175:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062210fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6497:x1874433577844992:12345-0@lo:253: Request processed in 45412us (45722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.856211:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599246.856316:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577844992:0@lo:253: 10000000:01000000:1.0:1787599246.856332:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787599246.856336:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599246.856338:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787599246.856339:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599246.856340:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787599246.856342:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599246.856344:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599246.856345:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599246.856354:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787599246.856356:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787599246.856358:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599246.856359:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599246.856379:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000091dfa032 from lustre-MDT0000 10000000:01000000:1.0:1787599246.856415:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787599246.856418:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787599246.856421:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96b34dcf99b8 10000000:01000000:1.0:1787599246.856426:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599246.856433:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b34dcf99b8 from 1 10000000:01000000:1.0:1787599246.856435:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599246.856468:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.856478:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.856487:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599246.856505:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845120:0@lo:101: 00000100:00100000:1.0:1787599246.856540:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.856588:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b02cdfc7 going to sleep for 11 seconds 00000100:00100000:0.0:1787599246.857686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845120 00000100:00100000:0.0:1787599246.857701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845120 00000100:00100000:0.0:1787599246.857755:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599246.857766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709acd52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6497:x1874433577845120:12345-0@lo:101: 00010000:00010000:0.0:1787599246.857781:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599246.857837:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cedff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599246.857872:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cedff expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599246.857882:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cedff expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599246.857891:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085a97ad8, rc 0) 00000100:00100000:0.0:1787599246.857966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709acd52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6497:x1874433577845120:12345-0@lo:101: Request processed in 202us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599246.857973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599246.858103:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845120:0@lo:101: 00010000:00010000:1.0:1787599246.858121:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.858131:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599246.858202:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845248:0@lo:501: 00000100:00100000:1.0:1787599246.858243:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.858277:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b02cdfc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.858850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845248 00000100:00100000:3.0:1787599246.858871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845248 00000100:00100000:3.0:1787599246.858909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599246.858918:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ba34535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6497:x1874433577845248:12345-0@lo:501: 00000100:00100000:3.0:1787599246.859028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ba34535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6497:x1874433577845248:12345-0@lo:501: Request processed in 111us (785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599246.859035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599246.859077:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845248:0@lo:501: 10000000:01000000:1.0:1787599246.859120:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787599246.859142:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.859151:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599246.859159:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b3707b1000 10000000:01000000:1.0:1787599246.859165:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787599246.859169:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b3707b1000 10000000:01000000:1.0:1787599246.859172:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787599246.859174:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b3707b1000 from 1 10000000:01000000:1.0:1787599246.859177:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787599246.859199:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.859205:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599246.859214:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599246.859228:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845376:0@lo:101: 00000100:00100000:1.0:1787599246.859258:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.859292:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b02cdfc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.859661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845376 00000100:00100000:3.0:1787599246.859666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845376 00000100:00100000:3.0:1787599246.859701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599246.859708:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c633b14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6497:x1874433577845376:12345-0@lo:101: 00010000:00010000:3.0:1787599246.859717:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599246.859729:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074c9d4f3/0x5d2988b0929cee14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cee0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.859747:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074c9d4f3/0x5d2988b0929cee14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cee0d expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.859755:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074c9d4f3/0x5d2988b0929cee14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee0d expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.859763:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074c9d4f3, rc 0) 00000100:00100000:3.0:1787599246.859834:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c633b14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+7:6497:x1874433577845376:12345-0@lo:101: Request processed in 126us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.859841:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599246.859885:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057222510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845376:0@lo:101: 00010000:00010000:2.0:1787599246.859899:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599246.859907:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599246.859919:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787599246.859927:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599246.859933:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000007c918bb7/0x5d2988b0929cee0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599246.859939:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787599246.859943:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599246.859946:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b3707b1000 10000000:01000000:2.0:1787599246.859949:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787599246.859952:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787599246.859954:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599246.859997:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599246.860003:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599246.860009:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599246.860032:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845504:0@lo:101: 00000100:00100000:2.0:1787599246.863314:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599246.863360:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f48d3356 going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.864309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845504 00000100:00100000:3.0:1787599246.864320:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845504 00000100:00100000:3.0:1787599246.864387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599246.864396:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000531b2c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+7:6497:x1874433577845504:12345-0@lo:101: 00010000:00010000:3.0:1787599246.864413:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599246.864430:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cee1b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.864456:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.864467:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599246.864475:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000970d1b1e, rc 0) 00000100:00100000:3.0:1787599246.864537:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000531b2c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+8:6497:x1874433577845504:12345-0@lo:101: Request processed in 142us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.864543:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599246.864645:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845504:0@lo:101: 00010000:00010000:2.0:1787599246.864664:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599246.864674:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599246.864776:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845632:0@lo:501: 00000100:00100000:2.0:1787599246.864853:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599246.864892:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f48d3356 going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.864907:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845632 00000100:00100000:3.0:1787599246.864913:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845632 00000100:00100000:3.0:1787599246.864945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599246.864951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057d88b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+8:6497:x1874433577845632:12345-0@lo:501: 00000100:00100000:3.0:1787599246.865097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057d88b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6497:x1874433577845632:12345-0@lo:501: Request processed in 145us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.865104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599246.865138:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845632:0@lo:501: 00000100:00100000:2.0:1787599246.865163:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845760:0@lo:503: 00000100:00100000:2.0:1787599246.865203:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599246.865226:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f48d3356 going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.865292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845760 00000100:00100000:3.0:1787599246.865296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845760 00000100:00100000:3.0:1787599246.865327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599246.865333:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000844a4c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6497:x1874433577845760:12345-0@lo:503: 00000100:00100000:3.0:1787599246.865411:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000844a4c11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6497:x1874433577845760:12345-0@lo:503: Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.865425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599246.865449:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577845760:0@lo:503: 00000100:00100000:1.0:1787599246.866007:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099273038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6542:1874433577845888:0@lo:502: 00000100:00100000:1.0:1787599246.866060:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599246.866086:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061fe41ad going to sleep for 11 seconds 00000100:00100000:3.0:1787599246.866155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577845888 00000100:00100000:3.0:1787599246.866160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577845888 00000100:00100000:3.0:1787599246.866195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599246.866202:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab268aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6542:x1874433577845888:12345-0@lo:502: 00000100:00100000:3.0:1787599246.866304:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab268aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6542:x1874433577845888:12345-0@lo:502: Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599246.866311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599246.866410:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099273038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6542:1874433577845888:0@lo:502: 00000020:01000000:2.0:1787599246.866441:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599246.866452:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599246.866454:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787599246.866459:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787599246.866462:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599246.866483:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001eeca929) 00000020:00000080:2.0:1787599246.866500:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787599246.866506:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787599246.866582:0:6542:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787599246.866590:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cee30 00000020:00000080:2.0:1787599246.867058:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787599246.867063:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599246.867067:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599246.867069:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787599246.867072:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599246.867075:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599246.867076:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787599246.867079:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599246.867086:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a1bbaa8c) 00000020:00000080:2.0:1787599246.867095:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787599246.867099:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787599246.867100:0:6542:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787599246.867103:0:6542:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787599246.867108:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599246.867150:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000091dfa032 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787599246.867163:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009a9476bf) 00000020:00000080:2.0:1787599246.867171:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787599246.867241:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787599246.867247:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cee45 00000020:00000080:2.0:1787599246.867348:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787599246.867354:0:6542:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787599246.867359:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d2988b0929cee4c 00080000:01000000:2.0:1787599246.867364:0:6542:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787599246.867368:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cee53 00080000:10000000:2.0:1787599246.868101:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787599246.868305:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787599246.875253:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787599247.011188:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787599247.011531:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787599247.016511:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787599247.016918:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787599247.029649:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b078ee5f) 00000020:00000080:2.0:1787599247.029673:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787599247.029760:0:6542:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599247.029768:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cee61 00000020:00000080:1.0:1787599247.039586:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787599247.041546:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787599247.055994:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1787599247.066067:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787599247.071493:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787599247.083524:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787599247.088621:0:6542:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787599247.095355:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d2988b0929cee68 00000020:00000080:1.0:1787599247.095878:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787599247.095891:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599247.095897:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599247.095899:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787599247.095902:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599247.095906:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599247.095907:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599247.095911:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599247.095912:0:6542:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787599247.095915:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599247.095917:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599247.095918:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787599247.095920:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599247.095924:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599247.095925:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787599247.095929:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787599247.095969:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787599247.096026:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6542:1874433577846016:0@lo:502: 00000100:00100000:1.0:1787599247.096120:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.096171:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087c3f65c going to sleep for 11 seconds 00000100:00100000:0.0:1787599247.096412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846016 00000100:00100000:0.0:1787599247.096420:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846016 00000100:00100000:0.0:1787599247.096473:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599247.096483:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d662001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6542:x1874433577846016:12345-0@lo:502: 00000100:00100000:0.0:1787599247.096725:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d662001 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6542:x1874433577846016:12345-0@lo:502: Request processed in 243us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.096733:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599247.107073:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6542:1874433577846016:0@lo:502: 00000020:01000000:2.0:1787599247.107153:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599247.107164:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599247.107167:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787599247.107172:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787599247.117426:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787599247.117467:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787599247.117480:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.117493:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599247.117522:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3707b1000 from 1 10000000:01000000:1.0:1787599247.117525:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599247.117573:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.117581:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.117592:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599247.117614:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd565c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846144:0@lo:101: 00000100:00100000:1.0:1787599247.117684:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.119087:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e80862d3 going to sleep for 11 seconds 00000100:00100000:3.0:1787599247.123012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846144 00000100:00100000:3.0:1787599247.123030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846144 00000100:00100000:3.0:1787599247.123103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599247.123113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d06ccb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:6497:x1874433577846144:12345-0@lo:101: 00010000:00010000:3.0:1787599247.123133:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599247.123153:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cee6f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.123179:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.123188:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.123225:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002cdda96f, rc 0) 00000100:00100000:3.0:1787599247.123324:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d06ccb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:6497:x1874433577846144:12345-0@lo:101: Request processed in 212us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599247.123330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599247.123511:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd565c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846144:0@lo:101: 00010000:00010000:1.0:1787599247.123529:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.123539:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599247.124181:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd565c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846272:0@lo:256: 00000100:00100000:1.0:1787599247.124238:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.124308:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e80862d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787599247.124524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846272 00000100:00100000:0.0:1787599247.124531:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846272 00000100:00100000:0.0:1787599247.124583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599247.124591:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f947437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:6497:x1874433577846272:12345-0@lo:256: 20000000:01000000:0.0:1787599247.124608:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787599247.124614:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787599247.124704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f947437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:6497:x1874433577846272:12345-0@lo:256: Request processed in 114us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.124711:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599247.127761:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd565c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846272:0@lo:256: 10000000:01000000:2.0:1787599247.128636:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599247.128665:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.128677:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599247.128685:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3707b1000 from 1 10000000:01000000:2.0:1787599247.128688:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599247.128731:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.128738:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.128746:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599247.128782:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846400:0@lo:101: 00000100:00100000:2.0:1787599247.129059:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599247.129170:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a26f0ea going to sleep for 11 seconds 00000100:00100000:0.0:1787599247.129446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846400 00000100:00100000:0.0:1787599247.129454:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846400 00000100:00100000:0.0:1787599247.129510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599247.129521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a858bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:6497:x1874433577846400:12345-0@lo:101: 00010000:00010000:0.0:1787599247.129537:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599247.129569:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cee7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.129594:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.129605:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.129613:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008aa2d25b, rc 0) 00000100:00100000:0.0:1787599247.129664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a858bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846400:12345-0@lo:101: Request processed in 145us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.129671:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599247.130084:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846400:0@lo:101: 00010000:00010000:2.0:1787599247.130100:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.130109:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599247.130179:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846528:0@lo:501: 00000100:00100000:2.0:1787599247.130221:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.131693:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846528 00000100:00100000:1.0:1787599247.131707:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846528 00000100:00100000:1.0:1787599247.131775:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599247.131784:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c738a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846528:12345-0@lo:501: 00000100:00100000:1.0:1787599247.132420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c738a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846528:12345-0@lo:501: Request processed in 636us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599247.132429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599247.136408:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a26f0ea going to sleep for 11 seconds 00000100:00100000:0.0:1787599247.136458:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb8b23ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846528:0@lo:501: 00000100:00100000:0.0:1787599247.136524:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d57fa16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846656:0@lo:503: 00000100:00100000:0.0:1787599247.136624:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599247.136668:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee415d48 going to sleep for 11 seconds 00000100:00100000:3.0:1787599247.136834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846656 00000100:00100000:3.0:1787599247.136842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846656 00000100:00100000:3.0:1787599247.136898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599247.136906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b09a3924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846656:12345-0@lo:503: 00000040:00080000:3.0:1787599247.136957:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599247.137018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b09a3924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846656:12345-0@lo:503: Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599247.137026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599247.137224:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d57fa16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846656:0@lo:503: 00000040:00080000:2.0:1787599247.144085:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787599247.148639:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787599247.148692:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599247.148764:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.148779:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599247.148904:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599247.148907:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b3707b1000 10000000:01000000:0.0:1787599247.148911:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b3707b1000 10000000:01000000:0.0:1787599247.148916:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599247.148925:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3707b1000 from 1 10000000:01000000:0.0:1787599247.148928:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599247.148980:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.148988:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.149001:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599247.149030:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005089614e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846784:0@lo:101: 00000100:00100000:0.0:1787599247.149120:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599247.149186:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009721e1e going to sleep for 11 seconds 00000100:00100000:1.0:1787599247.149713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846784 00000100:00100000:1.0:1787599247.149723:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846784 00000100:00100000:1.0:1787599247.149779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599247.149789:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab7dced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6497:x1874433577846784:12345-0@lo:101: 00010000:00010000:1.0:1787599247.149829:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599247.149844:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cee8b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.149880:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.149890:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.149899:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002bcbbc7, rc 0) 00000100:00100000:1.0:1787599247.149954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab7dced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577846784:12345-0@lo:101: Request processed in 167us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599247.149961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599247.150009:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005089614e pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846784:0@lo:101: 00010000:00010000:1.0:1787599247.150022:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599247.150030:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599247.150111:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e76e751b pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846912:0@lo:501: 00000100:00100000:1.0:1787599247.150134:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.150153:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025297d92 going to sleep for 11 seconds 00000100:00100000:0.0:1787599247.150425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577846912 00000100:00100000:0.0:1787599247.150430:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577846912 00000100:00100000:0.0:1787599247.150477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599247.150482:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c28a2f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577846912:12345-0@lo:501: 00000100:00100000:0.0:1787599247.150603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c28a2f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577846912:12345-0@lo:501: Request processed in 121us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.150610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599247.150678:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e76e751b pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577846912:0@lo:501: 00000100:00100000:3.0:1787599247.150716:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb27df18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577847040:0@lo:503: 00000100:00100000:3.0:1787599247.150751:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599247.150772:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ae32815 going to sleep for 11 seconds 00000100:00100000:1.0:1787599247.150827:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847040 00000100:00100000:1.0:1787599247.150832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847040 00000100:00100000:1.0:1787599247.150871:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599247.150877:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b28581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577847040:12345-0@lo:503: 00000100:00100000:1.0:1787599247.150952:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b28581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577847040:12345-0@lo:503: Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599247.150959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599247.150992:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb27df18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577847040:0@lo:503: 00000100:00100000:1.0:1787599247.151161:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6547:1874433577847168:0@lo:502: 00000100:00100000:1.0:1787599247.151190:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.151205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847168 00000100:00100000:1.0:1787599247.151208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847168 00000100:00100000:1.0:1787599247.151462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599247.151468:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6af625f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6547:x1874433577847168:12345-0@lo:502: 00000100:00100000:1.0:1787599247.151538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6af625f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6547:x1874433577847168:12345-0@lo:502: Request processed in 69us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599247.151546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599247.151580:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e80862d3 going to sleep for 11 seconds 00000100:00100000:1.0:1787599247.151591:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6547:1874433577847168:0@lo:502: 00000020:01000004:1.0:1787599247.151640:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787599247.151656:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e1a5dd35) 00000020:00000080:1.0:1787599247.151678:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787599247.151761:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000091dfa032 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787599247.151765:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000091dfa032 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787599247.151767:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000091dfa032 4 00010000:00080000:1.0:1787599247.151823:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cc87fbde@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1787599247.158182:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787599247.161435:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787599247.161484:0:6547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787599247.161499:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d2988b0929ceea0 00000100:00080000:1.0:1787599247.161512:0:6547:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599247.161517:0:6547:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cc87fbde using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599247.161681:0:6547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060b67097 x1874433577847296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599247.161701:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787599247.161943:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433577847296:0@lo:38: 00000100:00100000:3.0:1787599247.162015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599247.162101:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847296 00000100:00100000:3.0:1787599247.162108:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847296 00000100:00100000:3.0:1787599247.162138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599247.162145:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094fccce3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433577847296:12345-0@lo:38: 00000100:00100000:3.0:1787599247.162196:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094fccce3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433577847296:12345-0@lo:38: Request processed in 50us (181us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787599247.162202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599247.162261:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599247.162268:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000cc87fbde lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599247.162271:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787599247.162284:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433577847296:0@lo:38: 00000100:00100000:1.0:1787599247.163892:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6547:1874433577847424:0@lo:502: 00000100:00100000:1.0:1787599247.163962:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599247.163998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847424 00000100:00100000:1.0:1787599247.164004:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847424 00000100:00100000:1.0:1787599247.164039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599247.164057:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db9543bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6547:x1874433577847424:12345-0@lo:502: 00000100:00100000:1.0:1787599247.164157:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db9543bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6547:x1874433577847424:12345-0@lo:502: Request processed in 111us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599247.164164:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599247.164205:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e46b6568 going to sleep for 11 seconds 00000100:00100000:1.0:1787599247.164944:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6547:1874433577847424:0@lo:502: 00000040:00080000:1.0:1787599247.164975:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787599247.165203:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787599247.165349:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599247.166770:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.166812:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599247.166871:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599247.166875:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599247.166876:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599247.166877:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599247.166878:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599247.166879:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599247.166880:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599247.166882:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599247.166883:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599247.166885:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599247.166886:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599247.166888:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599247.166891:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787599247.166894:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599247.166895:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599247.166896:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599247.166897:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599247.166898:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599247.166899:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599247.166900:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599247.166901:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599247.166902:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599247.166903:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599247.166904:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599247.166905:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599247.166929:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787599247.166943:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000725ace10 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577847552:0@lo:253: 00000100:00100000:0.0:1787599247.167015:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599247.167067:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffbcd1c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599247.170588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847552 00000100:00100000:2.0:1787599247.170607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847552 00000100:00100000:2.0:1787599247.170673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599247.170683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f05d327e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577847552:12345-0@lo:253: 20000000:01000000:2.0:1787599247.170717:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787599247.170732:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787599247.183915:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787599247.183933:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787599247.184217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f05d327e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6497:x1874433577847552:12345-0@lo:253: Request processed in 13522us (17188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.184243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599247.184321:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000725ace10 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6497:1874433577847552:0@lo:253: 10000000:01000000:0.0:1787599247.184336:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787599247.184339:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599247.184341:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599247.184343:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599247.184344:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599247.184345:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599247.184346:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599247.184347:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599247.184349:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599247.184350:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599247.184352:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599247.184353:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599247.184354:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787599247.184370:0:6497:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787599247.187456:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787599247.187467:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787599247.187501:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.187521:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.187542:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.187585:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.187601:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 11 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599247.187614:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577847680:0@lo:104: 00000100:00100000:2.0:1787599247.187679:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599247.187748:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 000000006adfc25d going to sleep for 11 seconds 00000100:00100000:2.0:1787599247.188978:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847680 00000100:00100000:2.0:1787599247.188990:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847680 00000100:00100000:2.0:1787599247.189062:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599247.189071:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a120bee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577847680:12345-0@lo:104: 00010000:00010000:2.0:1787599247.189086:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.189160:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599247.189165:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a120bee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577847680:12345-0@lo:104: Request processed in 96us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599247.189172:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787599247.189280:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599247.189295:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.189304:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000056bd5c85 already unused, calling callback (00000000eeb26065) 10000000:00010000:3.0:1787599247.189307:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.189314:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599247.189321:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599247.189327:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599247.189361:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.189368:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599247.189393:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.189400:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 0000000056bd5c85/0x5d2988b0929cee6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee76 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599247.189418:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599247.189433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599247.189435:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599247.189993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a1bb8ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577847808:0@lo:103: 00000100:00100000:0.0:1787599247.193613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599247.193968:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847808 00000100:00100000:0.0:1787599247.193977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847808 00010000:00010000:0.0:1787599247.194011:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 12 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599247.194045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599247.194069:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000725ace10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3646:x1874433577847808:12345-0@lo:103: 00010000:00010000:0.0:1787599247.194083:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599247.194087:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 12 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194099:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 12 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194142:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194150:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599247.194166:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006699858s 00010000:00010000:0.0:1787599247.194169:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194176:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194181:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194187:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194194:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ede4485 already unused, calling callback (000000009558233a) 00010000:00010000:0.0:1787599247.194197:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.194204:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.195744:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599247.195770:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599247.195874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000725ace10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3646:x1874433577847808:12345-0@lo:103: Request processed in 1805us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599247.195899:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599247.195967:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a1bb8ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577847808:0@lo:103: 00010000:00010000:2.0:1787599247.196654:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002cdda96f/0x5d2988b0929cee76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cee6f expref: 11 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599247.196670:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577847680:0@lo:104: 00010000:00010000:2.0:1787599247.196685:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.196700:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.196706:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599247.196711:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ede4485/0x5d2988b0929ceea7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787599247.198441:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.199395:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787599247.199771:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.200315:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787599247.200519:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.200770:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787599247.201722:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.202045:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787599247.202355:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.202533:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787599247.203205:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787599247.203448:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1787599247.212366:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787599247.218618:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787599247.219039:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787599247.220549:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787599247.220669:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787599247.221149:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787599247.221157:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1787599247.221416:0:6552:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787599247.221421:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1787599247.221510:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599247.222772:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787599247.225006:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599247.228582:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787599247.228654:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787599247.228658:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787599247.229013:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787599247.229073:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787599247.229344:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787599247.229567:0:6497:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1787599247.230274:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787599247.230412:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787599247.230547:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787599247.230682:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787599247.230837:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787599247.230992:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787599247.231537:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787599247.231661:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787599247.231993:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787599247.232195:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787599247.232428:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787599247.232569:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787599247.232691:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787599247.233007:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787599247.233184:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787599247.233385:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787599247.233674:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787599247.233980:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787599247.234129:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787599247.234345:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787599247.234494:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787599247.234664:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787599247.234788:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787599247.235107:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787599247.235325:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787599247.235463:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787599247.235585:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787599247.235706:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787599247.236123:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787599247.236362:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787599247.236497:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787599247.236635:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787599247.236970:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787599247.239786:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787599247.240015:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1441c93988 00100000:10000000:2.0:1787599247.240023:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787599247.240658:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599247.240675:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599247.240692:0:6497:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787599247.240706:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787599247.242364:0:6497:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599247.242524:0:6497:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787599247.591649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599248.614440:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599249.638002:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599250.660930:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599251.610995:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787599251.688176:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599252.518533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787599252.518544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787599252.518547:0:37:0:(import.c:65:import_set_state_nolock()) 00000000cc87fbde lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599252.518560:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cc87fbde using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599252.518580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a982132 x1874433577848064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599252.518614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a982132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433577848064:0@lo:38: 00000100:00100000:1.0:1787599252.518679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599252.518738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848064 00000100:00100000:1.0:1787599252.518745:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848064 00000100:00100000:1.0:1787599252.518780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599252.518786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004898a779 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433577848064:12345-0@lo:38: 00010000:00080000:1.0:1787599252.518832:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1787599252.518868:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d2988b0929ceeae 00000004:00100000:1.0:1787599252.518912:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599252.519038:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000a5060c1d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599252.519084:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004898a779 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874433577848064:12345-0@lo:38: Request processed in 297us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599252.519090:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787599252.519121:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a982132 x1874433577848064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599252.519132:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787599252.519137:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787599252.519148:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599252.519150:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000cc87fbde lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599252.519154:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a982132 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433577848064:0@lo:38: 00000100:00100000:0.0:1787599252.520017:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577847936:0@lo:400: 00000100:00100000:0.0:1787599252.520070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599252.521708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577847936 00000100:00100000:1.0:1787599252.521723:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577847936 00000100:00100000:1.0:1787599252.521809:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599252.521819:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dee8984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:3647:x1874433577847936:12345-0@lo:400: 00000100:00100000:1.0:1787599252.521900:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dee8984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:3647:x1874433577847936:12345-0@lo:400: Request processed in 83us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599252.521907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599252.521957:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577847936:0@lo:400: 00000020:00000004:2.0:1787599252.542293:0:6850:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599252.542532:0:6850:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599252.722645:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599253.734677:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599254.762416:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787599255.077169:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599255.077176:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3707b1000 from 3 10000000:01000000:2.0:1787599255.077180:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599255.077219:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077230:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077240:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.077260:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577848192:0@lo:101: 00000100:00100000:2.0:1787599255.077319:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.077361:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e31479d5 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.077381:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848192 00000100:00100000:2.0:1787599255.077387:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848192 00000100:00100000:2.0:1787599255.077434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599255.077442:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eb35c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:6517:x1874433577848192:12345-0@lo:101: 00010000:00010000:2.0:1787599255.077453:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599255.077465:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929ceeb5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077485:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077519:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077528:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000296e79be, rc 0) 00000100:00100000:2.0:1787599255.077566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eb35c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6517:x1874433577848192:12345-0@lo:101: Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.077573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599255.077615:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577848192:0@lo:101: 00010000:00010000:2.0:1787599255.077628:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.077636:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.077689:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577848320:0@lo:256: 00000100:00100000:2.0:1787599255.077717:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.077732:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e31479d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787599255.078785:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848320 00000100:00100000:0.0:1787599255.078821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848320 00000100:00100000:0.0:1787599255.078861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599255.078867:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5c6528b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6517:x1874433577848320:12345-0@lo:256: 20000000:01000000:0.0:1787599255.078886:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599255.078901:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599255.078904:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787599255.079001:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5c6528b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:6517:x1874433577848320:12345-0@lo:256: Request processed in 134us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599255.079009:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599255.079091:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577848320:0@lo:256: 10000000:01000000:1.0:1787599255.079132:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599255.079139:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.079208:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1787599255.391780:0:6951:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599255.392233:0:6951:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599255.782249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599256.808307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599257.642087:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599257.642114:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000566add7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577848576:0@lo:400: 00000100:00100000:2.0:1787599257.642197:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599257.642207:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005146c673 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577848448:0@lo:400: 00000100:00100000:2.0:1787599257.642284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599257.642343:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848448 00000100:00100000:2.0:1787599257.642350:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848448 00000100:00100000:2.0:1787599257.642395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599257.642404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004e5e1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3647:x1874433577848448:12345-0@lo:400: 00000100:00100000:2.0:1787599257.642451:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004e5e1f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3647:x1874433577848448:12345-0@lo:400: Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599257.642470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599257.642519:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005146c673 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577848448:0@lo:400: 00000100:00100000:0.0:1787599257.642608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599257.642681:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848576 00000100:00100000:2.0:1787599257.642686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848576 00000100:00100000:2.0:1787599257.642719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599257.642725:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577848576:12345-0@lo:400: 00000100:00100000:2.0:1787599257.642762:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577848576:12345-0@lo:400: Request processed in 38us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599257.642768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787599257.642826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000566add7a x1874433577848576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599257.642837:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000566add7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577848576:0@lo:400: 00010000:00010000:1.0:1787599257.829333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599258.862651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599259.880118:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599260.901120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599261.948838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599262.783185:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a74f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577848832:0@lo:400: 00000100:00100000:0.0:1787599262.783185:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec802e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577848704:0@lo:400: 00000100:00100000:2.0:1787599262.783926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599262.784535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848832 00000100:00100000:1.0:1787599262.784546:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848832 00000100:00100000:1.0:1787599262.784604:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599262.784613:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb978532 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577848832:12345-0@lo:400: 00000100:00100000:1.0:1787599262.784679:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb978532 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577848832:12345-0@lo:400: Request processed in 68us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599262.784687:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787599262.784727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d0a74f4f x1874433577848832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599262.784740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a74f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577848832:0@lo:400: 00000100:00100000:0.0:1787599262.788931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599262.789064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848704 00000100:00100000:2.0:1787599262.789074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848704 00000100:00100000:2.0:1787599262.789130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599262.789139:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000521c15c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3646:x1874433577848704:12345-0@lo:400: 00000100:00100000:2.0:1787599262.789218:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000521c15c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3646:x1874433577848704:12345-0@lo:400: Request processed in 81us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599262.789226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599262.789568:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec802e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577848704:0@lo:400: 00010000:00010000:3.0:1787599262.949528:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599263.972998:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599265.001023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787599265.742460:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787599265.742464:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787599265.742466:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787599265.742603:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000caf2420e 00000020:01000004:0.0:1787599265.742620:0:7449:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787599265.742630:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787599265.742644:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f5825fc3) 00000020:00000080:0.0:1787599265.742658:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787599265.804596:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787599265.804678:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787599265.841165:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787599265.841407:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787599265.841417:0:7449:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787599265.841430:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929ceeca 00000020:01000004:3.0:1787599265.841437:0:7449:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787599265.841456:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787599265.841459:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787599265.841465:0:7449:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787599265.841491:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787599265.841496:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787599265.891649:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787599265.891688:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787599265.891692:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787599265.891694:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599265.891695:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599265.891697:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599265.891698:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599265.891699:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599265.891700:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599265.891702:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599265.891703:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599265.891704:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599265.891705:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599265.891708:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787599265.891710:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599265.891715:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599265.891716:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599265.891717:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599265.891718:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599265.891719:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599265.891720:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599265.891721:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599265.891722:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599265.891722:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599265.891723:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599265.891750:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787599265.891767:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b2242e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577848960:0@lo:253: 00000100:00100000:3.0:1787599265.892588:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.892682:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000692965a9 going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.902116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577848960 00000100:00100000:2.0:1787599265.902135:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577848960 00000100:00100000:2.0:1787599265.902212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599265.902229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b75bc8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577848960:12345-0@lo:253: 20000000:01000000:2.0:1787599265.902260:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787599265.902263:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787599265.902267:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787599265.902270:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787599265.902308:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1787599265.903364:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599265.904350:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787599265.905131:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787599265.905173:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787599265.905198:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787599265.905213:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787599265.905305:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787599265.905314:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1787599265.905329:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1787599265.905335:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1787599265.905346:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1787599265.905351:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1787599265.905363:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787599265.906498:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787599265.906635:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1787599265.906642:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787599265.906650:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1787599265.906653:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787599265.906660:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1787599265.906663:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1787599265.906669:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1787599265.906672:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787599265.906678:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787599265.906686:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787599265.906707:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787599265.906780:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1787599265.906789:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1787599265.906825:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787599265.906837:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787599265.906847:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1787599265.906850:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1787599265.906857:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787599265.906868:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787599265.906871:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1787599265.906898:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787599265.906906:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787599265.908744:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787599265.908939:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787599265.908970:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:0.0:1787599265.908973:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1787599265.908991:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787599265.908998:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787599265.909029:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787599265.909035:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1787599265.909050:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787599265.909057:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787599265.909072:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787599265.909087:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787599265.909157:0:6515:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787599265.909166:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1787599265.909630:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787599265.909734:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787599265.909763:0:6515:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:0.0:1787599265.909765:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1787599265.909780:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787599265.909786:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787599265.909905:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787599265.909916:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1787599265.909930:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787599265.909939:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1787599265.909953:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787599265.909969:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1787599265.909987:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787599265.909990:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787599265.909994:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787599265.910042:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787599265.910044:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787599265.910445:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787599265.910466:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787599265.910482:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787599265.910690:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787599265.910711:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787599265.910757:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787599265.910770:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787599265.910772:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599265.915461:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599265.915514:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599265.915554:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787599265.915732:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787599265.915759:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787599265.915788:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787599265.915910:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787599265.915913:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599265.916319:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599265.916358:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599265.916381:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787599265.916490:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787599265.916510:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787599265.916522:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787599265.916534:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787599265.916536:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787599265.916541:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787599265.916547:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787599265.917065:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787599265.917170:0:6515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787599265.939951:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787599265.940053:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940074:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cedff expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940082:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940088:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940107:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940151:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940165:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599265.940179:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef8bada9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849088:0@lo:104: 00000100:00100000:0.0:1787599265.940247:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599265.940307:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940315:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599265.940353:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849216:0@lo:104: 00000100:00100000:0.0:1787599265.940375:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599265.940405:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.940413:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 12 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599265.940422:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849088 00000100:00100000:0.0:1787599265.940422:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d974125 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849344:0@lo:104: 00000100:00100000:2.0:1787599265.940432:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849088 00000100:00100000:0.0:1787599265.940447:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599265.940458:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091631aa3 going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.940478:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849216 00000100:00100000:2.0:1787599265.940482:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849216 00000100:00100000:2.0:1787599265.940492:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849344 00000100:00100000:2.0:1787599265.940493:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849344 00000100:00100000:2.0:1787599265.940507:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599265.940516:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a1e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577849088:12345-0@lo:104: 00010000:00010000:2.0:1787599265.940530:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940612:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599265.940618:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a1e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577849088:12345-0@lo:104: Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.940625:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599265.940643:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599265.940649:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b959cded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6515:x1874433577849216:12345-0@lo:104: 00010000:00010000:2.0:1787599265.940656:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940692:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599265.940696:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b959cded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6515:x1874433577849216:12345-0@lo:104: Request processed in 49us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.940703:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599265.940714:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599265.940720:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eab9efdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6515:x1874433577849344:12345-0@lo:104: 00010000:00010000:2.0:1787599265.940725:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940750:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787599265.940754:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eab9efdd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6515:x1874433577849344:12345-0@lo:104: Request processed in 37us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.940760:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787599265.940773:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599265.940778:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940785:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fb517f32 already unused, calling callback (00000000eeb26065) 10000000:00010000:2.0:1787599265.940815:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940823:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599265.940830:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599265.940835:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599265.940860:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940866:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599265.940881:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940900:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cee8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940913:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599265.940916:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940921:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000debcc224 already unused, calling callback (00000000eeb26065) 10000000:00010000:2.0:1787599265.940923:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940929:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599265.940943:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599265.940948:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599265.940960:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940965:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599265.940977:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940982:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cee1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee22 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940990:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599265.940992:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.940997:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4a2a132 already unused, calling callback (00000000eeb26065) 10000000:00010000:2.0:1787599265.940999:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.941005:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599265.941015:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599265.941020:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599265.941038:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599265.941407:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef8bada9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849088:0@lo:104: 00000100:00100000:0.0:1787599265.941417:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849216:0@lo:104: 00000100:00100000:0.0:1787599265.941424:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d974125 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577849344:0@lo:104: 00010000:00010000:0.0:1787599265.941444:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.941506:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599265.941566:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599265.941572:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.941577:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929cedff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee06 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.941590:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599265.941591:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599265.941593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599265.941612:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003a7fb16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577849472:0@lo:103: 00000100:00100000:2.0:1787599265.941649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599265.941742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc193ee2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577849600:0@lo:103: 00000100:00100000:2.0:1787599265.941766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599265.942496:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599265.942505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577849728:0@lo:103: 00000100:00100000:2.0:1787599265.942533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599265.942588:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849472 00000100:00100000:0.0:1787599265.942595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849472 00010000:00010000:0.0:1787599265.942630:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 13 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599265.942668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849600 00000100:00100000:3.0:1787599265.942673:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849600 00010000:00010000:3.0:1787599265.942687:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599265.942717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599265.942724:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2bd7f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:3648:x1874433577849472:12345-0@lo:103: 00010000:00010000:3.0:1787599265.942737:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599265.942755:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942767:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942782:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002bcbbc7/0x5d2988b0929cee92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cee8b expref: 14 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942812:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599265.942848:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2bd7f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:3648:x1874433577849472:12345-0@lo:103: Request processed in 125us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.942855:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599265.942871:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599265.942876:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a51a7d8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:3645:x1874433577849600:12345-0@lo:103: 00010000:00010000:3.0:1787599265.942897:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599265.942901:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942909:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942918:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000970d1b1e/0x5d2988b0929cee22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cee1b expref: 12 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599265.942928:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599265.942948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a51a7d8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:3645:x1874433577849600:12345-0@lo:103: Request processed in 73us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.942954:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599265.943236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc193ee2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577849600:0@lo:103: 00000100:00100000:2.0:1787599265.943264:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003a7fb16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577849472:0@lo:103: 00000100:00100000:0.0:1787599265.943322:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849728 00000100:00100000:0.0:1787599265.943326:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849728 00010000:00010000:0.0:1787599265.943340:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 11 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599265.943353:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599265.943366:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021e660f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:3645:x1874433577849728:12345-0@lo:103: 00010000:00010000:0.0:1787599265.943374:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599265.943377:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 11 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943385:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 11 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943395:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cee06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cedff expref: 11 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943407:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943415:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943426:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943432:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943438:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943444:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943450:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e1e6c230 already unused, calling callback (000000009558233a) 00010000:00010000:0.0:1787599265.943453:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943465:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943484:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.943493:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599265.943520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021e660f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:3645:x1874433577849728:12345-0@lo:103: Request processed in 155us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599265.943526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599265.943578:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577849728:0@lo:103: 00010000:00010000:2.0:1787599265.943595:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.943602:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.943616:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e1e6c230/0x5d2988b0929ceed1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599265.943633:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787599265.947296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b75bc8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:7449:x1874433577848960:12345-0@lo:253: Request processed in 45060us (54702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.947313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599265.947420:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b2242e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577848960:0@lo:253: 10000000:01000000:1.0:1787599265.947435:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787599265.947438:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599265.947440:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787599265.947442:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599265.947443:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1787599265.947444:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599265.947445:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599265.947447:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599265.947448:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787599265.947450:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599265.947451:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599265.947471:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000caf2420e from lustre-MDT0001 10000000:01000000:1.0:1787599265.947500:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787599265.947503:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787599265.947511:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b34dcf99b8 local copy 10000000:01000000:1.0:1787599265.947515:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599265.947548:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.947575:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.947583:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.947599:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577849856:0@lo:101: 00000100:00100000:1.0:1787599265.947633:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.947673:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7eaf1a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.947722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849856 00000100:00100000:2.0:1787599265.947729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849856 00000100:00100000:2.0:1787599265.947773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599265.947780:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000767c41ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:7449:x1874433577849856:12345-0@lo:101: 00010000:00010000:2.0:1787599265.947826:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599265.947840:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a05188c7/0x5d2988b0929ceedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929ceed8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.947862:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a05188c7/0x5d2988b0929ceedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929ceed8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.947872:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a05188c7/0x5d2988b0929ceedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceed8 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.947881:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a05188c7, rc 0) 00000100:00100000:2.0:1787599265.947921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000767c41ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:7449:x1874433577849856:12345-0@lo:101: Request processed in 142us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.947927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599265.948079:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577849856:0@lo:101: 00010000:00010000:1.0:1787599265.948091:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948098:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.948205:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577849984:0@lo:501: 00000100:00100000:1.0:1787599265.948232:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.948257:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7eaf1a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.948364:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577849984 00000100:00100000:2.0:1787599265.948369:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577849984 00000100:00100000:2.0:1787599265.948401:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787599265.948415:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff12d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:7449:x1874433577849984:12345-0@lo:501: 00000100:00100000:2.0:1787599265.948478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff12d1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:7449:x1874433577849984:12345-0@lo:501: Request processed in 64us (245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599265.948484:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599265.948583:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577849984:0@lo:501: 10000000:01000000:1.0:1787599265.948596:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787599265.948611:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787599265.948616:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948623:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948635:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948659:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787599265.948683:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b3812cf000 10000000:01000000:1.0:1787599265.948688:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787599265.948692:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96b34dcf99b8 10000000:01000000:1.0:1787599265.948695:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787599265.948698:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96b34dcf99b8 from 1 10000000:01000000:1.0:1787599265.948700:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787599265.948716:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948723:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.948729:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.948739:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850112:0@lo:101: 00000100:00100000:1.0:1787599265.948764:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.948785:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a64676fd going to sleep for 11 seconds 00010000:00010000:0.0:1787599265.948849:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599265.948856:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.948865:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000770672d6 already unused, calling callback (00000000eeb26065) 10000000:00010000:0.0:1787599265.948869:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.948878:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599265.948894:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850112 10000000:00010000:0.0:1787599265.948894:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599265.948900:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850112 10000000:01000000:0.0:1787599265.948903:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787599265.948926:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787599265.948927:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599265.948935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cc2367e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:7449:x1874433577850112:12345-0@lo:101: 00010000:00010000:0.0:1787599265.948937:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599265.948943:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599265.948955:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f07988de/0x5d2988b0929ceeed lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929ceee6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.948967:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.948968:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f07988de/0x5d2988b0929ceeed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929ceee6 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.948985:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000770672d6/0x5d2988b0929ceed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929ceedf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.948988:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f07988de/0x5d2988b0929ceeed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceee6 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599265.949015:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599265.949018:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f07988de, rc 0) 00010000:00010000:0.0:1787599265.949019:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599265.949021:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599265.949034:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d974125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577850240:0@lo:103: 00000100:00100000:2.0:1787599265.949057:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cc2367e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:7449:x1874433577850112:12345-0@lo:101: Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.949063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599265.949087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.949233:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850112:0@lo:101: 00010000:00010000:1.0:1787599265.949243:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.949250:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599265.949274:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787599265.949292:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.949299:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000f1086caf/0x5d2988b0929ceee6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599265.949306:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b3812cf000 10000000:01000000:1.0:1787599265.949309:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787599265.949312:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b3812cf000 from 1 10000000:01000000:1.0:1787599265.949314:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787599265.949326:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.949332:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.949338:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.949347:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850368:0@lo:101: 00000100:00100000:1.0:1787599265.949371:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.949381:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a64676fd going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.950184:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850240 00000100:00100000:2.0:1787599265.950193:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850240 00000100:00100000:2.0:1787599265.950234:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599265.950241:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a2f8d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:3647:x1874433577850240:12345-0@lo:103: 00010000:00010000:2.0:1787599265.950251:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599265.950266:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a05188c7/0x5d2988b0929ceedf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929ceed8 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.950292:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599265.950354:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a2f8d28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:3647:x1874433577850240:12345-0@lo:103: Request processed in 113us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.950361:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599265.950395:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d974125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577850240:0@lo:103: 00000100:00100000:2.0:1787599265.950418:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850368 00000100:00100000:2.0:1787599265.950422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850368 00000100:00100000:2.0:1787599265.950448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599265.950454:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f6ec442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:7449:x1874433577850368:12345-0@lo:101: 00010000:00010000:2.0:1787599265.950463:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599265.950472:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c2888b9/0x5d2988b0929ceefb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929ceef4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.950487:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c2888b9/0x5d2988b0929ceefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929ceef4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.950496:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c2888b9/0x5d2988b0929ceefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceef4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.950503:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c2888b9, rc 0) 00000100:00100000:1.0:1787599265.951366:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850368:0@lo:101: 00010000:00010000:1.0:1787599265.951384:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.951394:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599265.951420:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:2.0:1787599265.951500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f6ec442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:7449:x1874433577850368:12345-0@lo:101: Request processed in 78us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.951508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787599265.952176:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.952186:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000c8a0d491/0x5d2988b0929ceef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599265.952194:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787599265.952200:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599265.952206:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b3812cf000 10000000:01000000:1.0:1787599265.952208:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787599265.952212:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787599265.952215:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787599265.952243:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.952250:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.952257:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.952273:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850496:0@lo:101: 00000100:00100000:1.0:1787599265.952317:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.952358:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a64676fd going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.952407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850496 00000100:00100000:2.0:1787599265.952413:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850496 00000100:00100000:2.0:1787599265.952457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599265.952464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004263b663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:7449:x1874433577850496:12345-0@lo:101: 00010000:00010000:2.0:1787599265.952484:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599265.952496:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b13b93a4/0x5d2988b0929cef09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cef02 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.952513:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b13b93a4/0x5d2988b0929cef09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.952522:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b13b93a4/0x5d2988b0929cef09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599265.952529:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b13b93a4, rc 0) 00000100:00100000:2.0:1787599265.952634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004263b663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850496:12345-0@lo:101: Request processed in 171us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.952641:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599265.954736:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850496:0@lo:101: 00010000:00010000:1.0:1787599265.954756:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599265.954777:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599265.954915:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850624:0@lo:501: 00000100:00100000:1.0:1787599265.954958:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.954988:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a64676fd going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.955129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850624 00000100:00100000:2.0:1787599265.955137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850624 00000100:00100000:2.0:1787599265.955189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599265.955198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f7e0ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850624:12345-0@lo:501: 00000100:00100000:2.0:1787599265.955316:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f7e0ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850624:12345-0@lo:501: Request processed in 119us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.955324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599265.956021:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850624:0@lo:501: 00000100:00100000:1.0:1787599265.956140:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850752:0@lo:503: 00000100:00100000:1.0:1787599265.956195:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599265.956234:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a64676fd going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.956945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850752 00000100:00100000:2.0:1787599265.956954:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850752 00000100:00100000:2.0:1787599265.957007:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599265.957016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae13595e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850752:12345-0@lo:503: 00000100:00100000:2.0:1787599265.957167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae13595e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850752:12345-0@lo:503: Request processed in 152us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.957175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599265.957356:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a6ab43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850752:0@lo:503: 00000040:00080000:3.0:1787599265.957683:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599265.957761:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850880:0@lo:502: 00000100:00100000:3.0:1787599265.957841:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.957868:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc60749a going to sleep for 11 seconds 00000100:00100000:1.0:1787599265.957942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577850880 00000100:00100000:1.0:1787599265.957948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577850880 00000100:00100000:1.0:1787599265.957984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787599265.957992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b4da24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850880:12345-0@lo:502: 00000100:00100000:1.0:1787599265.958196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b4da24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577850880:12345-0@lo:502: Request processed in 205us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599265.958204:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599265.958281:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577850880:0@lo:502: 00000040:00080000:3.0:1787599265.958481:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787599265.958508:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787599265.958521:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787599265.958533:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787599265.958545:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787599265.958557:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787599265.958569:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787599265.958581:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787599265.958593:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787599265.958606:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787599265.958617:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787599265.958629:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787599265.958658:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787599265.958673:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787599265.958685:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787599265.958698:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787599265.958708:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787599265.958719:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787599265.958730:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787599265.958740:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787599265.958751:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787599265.958761:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787599265.958772:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787599265.958839:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851008:0@lo:502: 00000100:00100000:3.0:1787599265.958904:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.958956:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc60749a going to sleep for 11 seconds 00000100:00100000:2.0:1787599265.959131:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851008 00000100:00100000:2.0:1787599265.959137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851008 00000100:00100000:2.0:1787599265.959170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599265.959177:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8c4089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577851008:12345-0@lo:502: 00000100:00100000:2.0:1787599265.959275:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8c4089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577851008:12345-0@lo:502: Request processed in 98us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599265.959283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599265.959417:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851008:0@lo:502: 00000040:00080000:3.0:1787599265.959461:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787599265.959468:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1787599265.962326:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599265.962343:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599265.962346:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599265.962354:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787599265.962357:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599265.962374:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000cc5a8274) 00000020:00000080:2.0:1787599265.962398:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787599265.962403:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787599265.962488:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599265.962495:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929cef17 00000020:00000080:2.0:1787599265.962691:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787599265.962696:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599265.962699:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599265.962700:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599265.962702:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599265.962705:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599265.962706:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787599265.962709:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599265.962715:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000005224fc89) 00000020:00000080:2.0:1787599265.962725:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1787599265.962728:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787599265.962729:0:7461:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787599265.962731:0:7461:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787599265.962737:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599265.962784:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000caf2420e from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787599265.963395:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007bd02a66) 00000020:00000080:2.0:1787599265.963407:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1787599265.963494:0:7461:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787599265.963500:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cef2c 00000020:00000080:2.0:1787599265.963610:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787599265.963618:0:7461:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787599265.963622:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5d2988b0929cef33 00080000:01000000:2.0:1787599265.963629:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787599265.963633:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929cef3a 00080000:10000000:2.0:1787599265.964280:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787599265.964441:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787599266.028298:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599266.120658:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787599266.121285:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787599266.127753:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787599266.129715:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787599266.149976:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787599266.150000:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599266.150007:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.150009:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787599266.150014:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599266.150021:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.150022:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787599266.150025:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787599266.150031:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:0.0:1787599266.150236:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787599266.150250:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000006b74a390) 00000020:00000080:0.0:1787599266.150272:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787599266.150277:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787599266.150349:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787599266.150355:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787599266.150362:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929cef48 00010000:00080000:0.0:1787599266.150831:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a22e2e39@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1787599266.155743:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787599266.167487:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787599266.167508:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787599266.167569:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787599266.167592:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cef4f 00000100:00080000:0.0:1787599266.167604:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599266.167609:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a22e2e39 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599266.167647:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef8bada9 x1874433577851136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599266.167705:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef8bada9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577851136:0@lo:38: 00000100:00100000:1.0:1787599266.167780:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787599266.167948:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787599266.168011:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599266.168016:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168018:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787599266.168020:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787599266.168023:0:7461:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787599266.168024:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787599266.168026:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787599266.168027:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787599266.168029:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168030:0:7461:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787599266.168032:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599266.168036:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168038:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787599266.168054:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787599266.168084:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787599266.168095:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599266.168098:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168099:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787599266.168101:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599266.168104:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168105:0:7461:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787599266.168108:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787599266.168109:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787599266.168138:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599266.168141:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599266.168149:0:7461:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787599266.168153:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787599266.168761:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599266.168777:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577851264:0@lo:400: 00000100:00100000:2.0:1787599266.168859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.171716:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851264 00000100:00100000:0.0:1787599266.171733:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851264 00000100:00100000:0.0:1787599266.171815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599266.171825:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003a7fb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577851264:12345-0@lo:400: 00000100:00100000:0.0:1787599266.171932:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003a7fb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577851264:12345-0@lo:400: Request processed in 110us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.171941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787599266.172503:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ea896940 x1874433577851264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599266.172519:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577851264:0@lo:400: 00000100:00100000:3.0:1787599266.172625:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851136 00000100:00100000:3.0:1787599266.172632:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851136 00000100:00100000:3.0:1787599266.172662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599266.172668:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a982132 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433577851136:12345-0@lo:38: 00010000:00080000:3.0:1787599266.172692:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1787599266.172727:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cef56 00000004:00100000:3.0:1787599266.172742:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787599266.172747:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1787599266.172840:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1787599266.172897:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787599266.172910:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.172920:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000bb1429eb/0x5d2988b0929cef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599266.172928:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3812cf000 from 1 10000000:01000000:3.0:1787599266.172931:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599266.172963:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.172970:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.172979:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.173486:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851392:0@lo:101: 00000100:00100000:3.0:1787599266.173542:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599266.173621:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05e2bcc going to sleep for 11 seconds 00000100:00080000:3.0:1787599266.178693:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000ee9bc7b4 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599266.178830:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a982132 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433577851136:12345-0@lo:38: Request processed in 6158us (11048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599266.178841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599266.179026:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599266.179037:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787599266.179056:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787599266.179062:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599266.179065:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000a22e2e39 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599266.179077:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef8bada9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577851136:0@lo:38: 00000100:00100000:2.0:1787599266.182298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851392 00000100:00100000:2.0:1787599266.182314:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851392 00000100:00100000:2.0:1787599266.182420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599266.182430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007246e16f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+12:7449:x1874433577851392:12345-0@lo:101: 00010000:00010000:2.0:1787599266.182448:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599266.182464:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cef5d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.182514:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.182524:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.182534:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a05188c7, rc 0) 00000100:00100000:2.0:1787599266.182618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007246e16f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:7449:x1874433577851392:12345-0@lo:101: Request processed in 191us (9077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.182625:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599266.182724:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851392:0@lo:101: 00010000:00010000:3.0:1787599266.182742:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.182751:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.183352:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851520:0@lo:256: 00000100:00100000:3.0:1787599266.183404:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599266.189646:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05e2bcc going to sleep for 11 seconds 00000100:00100000:0.0:1787599266.194054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851520 00000100:00100000:0.0:1787599266.194073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851520 00000100:00100000:0.0:1787599266.194129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599266.194136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000d6b7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:7449:x1874433577851520:12345-0@lo:256: 20000000:01000000:0.0:1787599266.194162:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787599266.194189:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787599266.194192:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787599266.194313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000d6b7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:7449:x1874433577851520:12345-0@lo:256: Request processed in 178us (10909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.194321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599266.194664:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851520:0@lo:256: 10000000:01000000:3.0:1787599266.195316:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599266.195336:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.195353:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599266.195362:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3812cf000 from 1 10000000:01000000:3.0:1787599266.196073:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599266.196120:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.196128:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.196137:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.196160:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851648:0@lo:101: 00000100:00100000:3.0:1787599266.196224:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.196722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851648 00000100:00100000:0.0:1787599266.196736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851648 00000100:00100000:0.0:1787599266.196778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599266.196785:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba56e93e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:7449:x1874433577851648:12345-0@lo:101: 00010000:00010000:0.0:1787599266.196817:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599266.196829:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cef6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599266.196855:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599266.196893:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599266.196907:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085a97ad8, rc 0) 00000100:00100000:0.0:1787599266.196949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba56e93e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577851648:12345-0@lo:101: Request processed in 164us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.196955:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599266.198256:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05e2bcc going to sleep for 11 seconds 00000100:00100000:3.0:1787599266.198287:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851648:0@lo:101: 00010000:00010000:3.0:1787599266.198304:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.198314:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.198533:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851776:0@lo:501: 00000100:00100000:3.0:1787599266.198588:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599266.198618:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05e2bcc going to sleep for 11 seconds 00000100:00100000:0.0:1787599266.198683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851776 00000100:00100000:0.0:1787599266.198689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851776 00000100:00100000:0.0:1787599266.198724:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599266.198735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709c1a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577851776:12345-0@lo:501: 00000100:00100000:0.0:1787599266.198865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709c1a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577851776:12345-0@lo:501: Request processed in 130us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.198878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599266.198963:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851776:0@lo:501: 00000100:00100000:3.0:1787599266.198988:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851904:0@lo:503: 00000100:00100000:3.0:1787599266.199037:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599266.199181:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05e2bcc going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.199328:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577851904 00000100:00100000:2.0:1787599266.199333:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577851904 00000100:00100000:0.0:1787599266.199508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599266.199516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e713a12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577851904:12345-0@lo:503: 00000040:00080000:0.0:1787599266.199552:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599266.199604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e713a12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577851904:12345-0@lo:503: Request processed in 89us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.199610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599266.199705:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577852032:0@lo:41: 00000100:00100000:2.0:1787599266.199738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.199781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852032 00000100:00100000:2.0:1787599266.199784:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852032 00000100:00100000:2.0:1787599266.199827:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599266.199832:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc193ee2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874433577852032:12345-0@lo:41: 00000004:00000024:2.0:1787599266.199853:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787599266.199895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc193ee2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1874433577852032:12345-0@lo:41: Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.199901:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599266.199928:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577852032:0@lo:41: 00000100:00100000:3.0:1787599266.200015:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577851904:0@lo:503: 00000040:00080000:3.0:1787599266.200527:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599266.200578:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787599266.200650:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599266.202038:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1787599266.203217:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787599266.203248:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599266.203266:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.203301:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599266.203359:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787599266.203363:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b3812cf000 10000000:01000000:2.0:1787599266.203366:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b3812cf000 10000000:01000000:2.0:1787599266.203495:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599266.203504:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3812cf000 from 1 10000000:01000000:2.0:1787599266.203506:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599266.203540:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.203547:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.203557:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599266.203576:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852160:0@lo:101: 00000100:00100000:2.0:1787599266.203647:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.203711:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a84407b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787599266.204217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852160 00000100:00100000:3.0:1787599266.204225:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852160 00000100:00100000:3.0:1787599266.204274:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787599266.204281:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e789efac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:7449:x1874433577852160:12345-0@lo:101: 00010000:00010000:3.0:1787599266.204294:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599266.204306:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc7ae110/0x5d2988b0929cef80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cef79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.204328:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc7ae110/0x5d2988b0929cef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.204337:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc7ae110/0x5d2988b0929cef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.204345:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc7ae110, rc 0) 00000100:00100000:2.0:1787599266.204522:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852160:0@lo:101: 00010000:00010000:2.0:1787599266.204536:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.204544:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.205255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e789efac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852160:12345-0@lo:101: Request processed in 971us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599266.205264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599266.205343:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852288:0@lo:501: 00000100:00100000:2.0:1787599266.205504:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.205580:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a84407b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787599266.205626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852288 00000100:00100000:0.0:1787599266.205633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852288 00000100:00100000:0.0:1787599266.205709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599266.205718:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b5ac42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852288:12345-0@lo:501: 00000100:00100000:0.0:1787599266.206430:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b5ac42e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852288:12345-0@lo:501: Request processed in 711us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.206453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599266.206599:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852288:0@lo:501: 00000100:00100000:2.0:1787599266.206660:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852416:0@lo:503: 00000100:00100000:2.0:1787599266.206704:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.206740:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a84407b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787599266.207092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852416 00000100:00100000:3.0:1787599266.207099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852416 00000100:00100000:3.0:1787599266.207140:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599266.207148:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa6627ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852416:12345-0@lo:503: 00000100:00100000:3.0:1787599266.207548:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa6627ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852416:12345-0@lo:503: Request processed in 400us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599266.207556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787599266.207787:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852416:0@lo:503: 00000040:00080000:0.0:1787599266.208939:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599266.209028:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d280c584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852544:0@lo:502: 00000100:00100000:0.0:1787599266.209210:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.209310:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ed5098e going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.209516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852544 00000100:00100000:2.0:1787599266.209523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852544 00000100:00100000:2.0:1787599266.209573:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787599266.209582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026809378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852544:12345-0@lo:502: 00000100:00100000:2.0:1787599266.209696:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026809378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852544:12345-0@lo:502: Request processed in 115us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.209704:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599266.209828:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d280c584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852544:0@lo:502: 00000040:00080000:0.0:1787599266.210309:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787599266.210341:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787599266.210357:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787599266.210383:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787599266.210660:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787599266.210681:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787599266.210697:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787599266.210712:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787599266.210728:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787599266.210743:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787599266.210757:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787599266.210772:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787599266.210787:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787599266.210857:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787599266.210874:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787599266.210901:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787599266.210918:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787599266.210932:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787599266.210946:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787599266.210961:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787599266.210974:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787599266.210986:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787599266.210998:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787599266.211012:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787599266.211664:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787599266.211688:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787599266.211703:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787599266.211716:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787599266.211753:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d280c584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852672:0@lo:502: 00000100:00100000:0.0:1787599266.212185:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.212229:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ed5098e going to sleep for 11 seconds 00000100:00100000:3.0:1787599266.212310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852672 00000100:00100000:3.0:1787599266.212318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852672 00000100:00100000:3.0:1787599266.212364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599266.212382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c64f96ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852672:12345-0@lo:502: 00000100:00100000:3.0:1787599266.212671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c64f96ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852672:12345-0@lo:502: Request processed in 290us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599266.212679:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787599266.212767:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d280c584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852672:0@lo:502: 00000040:00080000:0.0:1787599266.212944:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787599266.212954:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787599266.213778:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787599266.213921:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000bbd357ae) 00000020:00000080:3.0:1787599266.213946:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787599266.214209:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000caf2420e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787599266.214213:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000caf2420e from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787599266.214215:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000caf2420e 3 00010000:00080000:3.0:1787599266.214249:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009b7e4e87@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599266.219096:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787599266.219297:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787599266.219337:0:7467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599266.219504:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5d2988b0929cef8e 00000100:00080000:3.0:1787599266.219514:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599266.219519:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009b7e4e87 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599266.219552:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047395b8f x1874433577852800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599266.219586:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787599266.220204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433577852800:0@lo:38: 00000100:00100000:0.0:1787599266.220284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787599266.223354:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787599266.223567:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787599266.223605:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599266.223620:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599266.223634:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000debcc224/0x5d2988b0929cef79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599266.223698:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599266.223701:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787599266.223702:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599266.223703:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599266.223705:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599266.223707:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599266.223708:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599266.223711:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599266.223712:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599266.223714:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599266.223715:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599266.223720:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787599266.223727:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599266.223728:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787599266.223729:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599266.223730:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599266.223731:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599266.223732:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599266.223733:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599266.223734:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599266.223735:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599266.223736:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599266.223737:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599266.223764:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787599266.223783:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e29d9b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852928:0@lo:253: 00000100:00100000:0.0:1787599266.223903:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.223935:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e65a8b23 going to sleep for 11 seconds 40000000:00080000:1.0:1787599266.224565:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1787599266.225226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852928 00000100:00100000:2.0:1787599266.225237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852928 00000100:00100000:2.0:1787599266.225293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787599266.225302:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1fc6bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852928:12345-0@lo:253: 20000000:01000000:2.0:1787599266.225332:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787599266.225345:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787599266.227848:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577852800 00000100:00100000:3.0:1787599266.227868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577852800 00000100:00100000:3.0:1787599266.227932:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599266.227942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d280c584 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874433577852800:12345-0@lo:38: 00010000:00080000:3.0:1787599266.227998:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1787599266.228058:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5d2988b0929cef95 00000004:00100000:3.0:1787599266.228076:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599266.228113:0:6521:0:(import.c:65:import_set_state_nolock()) 00000000915d7ee6 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599266.228206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d280c584 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874433577852800:12345-0@lo:38: Request processed in 264us (7922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599266.228212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787599266.228281:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047395b8f x1874433577852800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599266.228289:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599266.228296:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787599266.228302:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787599266.228305:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599266.228307:0:3644:0:(import.c:65:import_set_state_nolock()) 000000009b7e4e87 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599266.228311:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433577852800:0@lo:38: 00000001:00100000:1.0:1787599266.230573:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787599266.230892:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787599266.230912:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787599266.230972:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787599266.230977:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787599266.231301:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.231319:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.231326:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.231332:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.231371:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.231392:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 15 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.231408:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577853056:0@lo:104: 00000100:00100000:3.0:1787599266.231475:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.231517:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853056 00010000:00010000:3.0:1787599266.231529:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599266.231530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853056 00010000:00010000:3.0:1787599266.231536:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 15 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.231543:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577853184:0@lo:104: 00000100:00100000:3.0:1787599266.231562:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599266.231661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1fc6bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7449:x1874433577852928:12345-0@lo:253: Request processed in 6360us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599266.231670:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599266.231865:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c96dcf31 going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.231878:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853184 00000100:00100000:2.0:1787599266.231890:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853184 00000100:00100000:2.0:1787599266.231909:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599266.231916:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092a770c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577853056:12345-0@lo:104: 00010000:00010000:2.0:1787599266.231927:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.231968:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599266.231973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092a770c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577853056:12345-0@lo:104: Request processed in 58us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.231979:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599266.231990:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599266.231995:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003514b46c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577853184:12345-0@lo:104: 00010000:00010000:2.0:1787599266.232002:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232033:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599266.232037:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003514b46c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577853184:12345-0@lo:104: Request processed in 43us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.232056:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787599266.232073:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599266.232079:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232086:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000970d1b1e already unused, calling callback (00000000eeb26065) 10000000:00010000:2.0:1787599266.232089:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232107:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599266.232114:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599266.232119:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599266.232148:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232154:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599266.232169:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232175:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000970d1b1e/0x5d2988b0929cef5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef64 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232187:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599266.232189:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232194:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ede4485 already unused, calling callback (00000000eeb26065) 10000000:00010000:2.0:1787599266.232196:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232200:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.232202:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047395b8f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577853056:0@lo:104: 10000000:00010000:2.0:1787599266.232206:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599266.232210:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577853184:0@lo:104: 10000000:01000000:2.0:1787599266.232216:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599266.232226:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232228:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232234:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599266.232245:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232250:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929ceeb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599266.232264:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599266.232265:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599266.232275:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577853312:0@lo:103: 00000100:00100000:2.0:1787599266.232302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.232341:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee8b3de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577853440:0@lo:103: 00000100:00100000:2.0:1787599266.232365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.232391:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853312 00000100:00100000:2.0:1787599266.232466:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853312 00010000:00010000:2.0:1787599266.232485:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 15 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599266.232502:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853440 00000100:00100000:2.0:1787599266.232504:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853440 00010000:00010000:2.0:1787599266.232512:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 16 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599266.232522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599266.232533:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000704d493f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3646:x1874433577853312:12345-0@lo:103: 00010000:00010000:2.0:1787599266.232544:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599266.232550:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 16 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232559:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 16 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232570:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a05188c7/0x5d2988b0929cef64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cef5d expref: 16 pid: 6515 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232580:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599266.232606:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000704d493f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3646:x1874433577853312:12345-0@lo:103: Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.232613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599266.232626:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599266.232632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000178ae894 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:3647:x1874433577853440:12345-0@lo:103: 00010000:00010000:2.0:1787599266.232639:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599266.232642:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 14 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232650:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 14 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232658:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000296e79be/0x5d2988b0929ceebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929ceeb5 expref: 14 pid: 6514 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232669:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232685:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599266.232698:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006699858s 00010000:00010000:2.0:1787599266.232703:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232707:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232711:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232714:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232717:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2b97fe8 already unused, calling callback (000000009558233a) 00010000:00010000:2.0:1787599266.232719:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232723:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232735:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599266.232743:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599266.232756:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.232763:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599266.232769:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cef9c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599266.232769:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000178ae894 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:3647:x1874433577853440:12345-0@lo:103: Request processed in 138us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.232774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599266.232850:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee8b3de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577853440:0@lo:103: 00000100:00100000:2.0:1787599266.232869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577853312:0@lo:103: 00010000:00010000:1.0:1787599266.232904:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599266.232925:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e29d9b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7449:1874433577852928:0@lo:253: 10000000:01000000:1.0:1787599266.232936:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787599266.232939:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599266.232941:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787599266.232942:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599266.232943:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599266.232944:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599266.232945:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599266.232946:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599266.232948:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787599266.232949:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787599266.232951:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599266.232952:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787599266.232965:0:7449:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787599266.236313:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787599266.236521:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787599266.236658:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787599266.236766:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787599266.238213:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787599266.238404:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787599266.239233:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787599266.239393:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787599266.239540:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787599266.239640:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787599266.239765:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787599266.240208:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787599266.241478:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787599266.241524:0:7472:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787599266.241528:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787599266.241654:0:7473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1787599266.241697:0:7473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1874433577853568:0@lo:700: 00000100:00100000:0.0:1787599266.241757:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.241854:0:7473:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ed5098e going to sleep for 11 seconds 00000040:01000000:3.0:1787599266.241952:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787599266.242196:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853568 00000100:00100000:1.0:1787599266.242205:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853568 00000100:00100000:1.0:1787599266.242255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599266.242263:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f450b0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1874433577853568:12345-0@lo:700: 00000100:00100000:1.0:1787599266.242782:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a05d63f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577853696:0@lo:1000: 00000100:00100000:1.0:1787599266.242857:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599266.242879:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd49e31d going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.242942:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853696 00000100:00100000:2.0:1787599266.242948:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853696 00000100:00100000:2.0:1787599266.242977:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599266.242984:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004883dba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577853696:12345-0@lo:1000: 00000100:00100000:2.0:1787599266.243070:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004883dba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577853696:12345-0@lo:1000: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.243078:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599266.243146:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a05d63f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577853696:0@lo:1000: 00000040:01000000:1.0:1787599266.243175:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1787599266.243196:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a05d63f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577853824:0@lo:700: 00000100:00100000:1.0:1787599266.243229:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599266.243252:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e5cc97b going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.243295:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853824 00000100:00100000:2.0:1787599266.243300:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853824 00000100:00100000:2.0:1787599266.243356:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599266.243363:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebaf66db pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577853824:12345-0@lo:700: 00000100:00100000:2.0:1787599266.243415:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebaf66db pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577853824:12345-0@lo:700: Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.243422:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1787599266.244263:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787599266.244344:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787599266.244705:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787599266.244710:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787599266.244851:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599266.245753:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 40000000:02000000:1.0:1787599266.246832:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1787599266.246980:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a05d63f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577853824:0@lo:700: 00000100:00100000:2.0:1787599266.247190:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1874433577853952:0@lo:900: 00000100:00100000:2.0:1787599266.247259:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787599266.247952:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787599266.248007:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1787599266.248235:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e344e5c going to sleep for 11 seconds 00000040:00080000:3.0:1787599266.248599:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787599266.248920:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787599266.249739:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:0.0:1787599266.249922:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577853952 00000100:00100000:0.0:1787599266.249932:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577853952 00100000:10000000:3.0:1787599266.250167:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787599266.250303:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787599266.250563:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:1.0:1787599266.250641:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f450b0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7473:x1874433577853568:12345-0@lo:700: Request processed in 8375us (8881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599266.250653:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:3.0:1787599266.250709:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787599266.250821:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787599266.251042:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787599266.251158:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787599266.251364:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787599266.251464:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787599266.251554:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787599266.251639:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787599266.251729:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787599266.251835:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787599266.251967:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:0.0:1787599266.252067:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599266.252081:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8b3de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1874433577853952:12345-0@lo:900: 00100000:10000000:3.0:1787599266.252107:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:0.0:1787599266.252163:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8b3de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1874433577853952:12345-0@lo:900: Request processed in 87us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599266.252171:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787599266.252268:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ea896940 x1874433577853952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599266.252283:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea896940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1874433577853952:0@lo:900: 00000100:00100000:1.0:1787599266.252405:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2e41f0d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854080:0@lo:1000: 00100000:10000000:3.0:1787599266.252421:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:1.0:1787599266.252457:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599266.252483:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7f74c29 going to sleep for 11 seconds 00100000:10000000:3.0:1787599266.252551:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:2.0:1787599266.252612:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854080 00000100:00100000:2.0:1787599266.252621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854080 00000100:00100000:2.0:1787599266.252669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599266.252676:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0502707 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854080:12345-0@lo:1000: 00100000:10000000:3.0:1787599266.252681:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:2.0:1787599266.252744:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0502707 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854080:12345-0@lo:1000: Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599266.252751:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599266.252776:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2e41f0d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854080:0@lo:1000: 00000004:00080000:2.0:1787599266.252832:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000cd49e31d with version 0 00100000:10000000:3.0:1787599266.252847:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000020:00100000:2.0:1787599266.252848:0:7474:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787599266.252853:0:7474:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e2bd7f77 x1874433577854336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599266.252866:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2bd7f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854336:0@lo:1000: 00000100:00100000:2.0:1787599266.252905:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599266.252924:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854336 00000100:00100000:2.0:1787599266.252928:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854336 00000100:00100000:2.0:1787599266.252943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599266.252953:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a51a7d8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854336:12345-0@lo:1000: 00100000:10000000:3.0:1787599266.253201:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00010000:00080000:0.0:1787599266.253207:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000238eb3ea x1874433577853568/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787599282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599266.253218:0:7473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1874433577853568:0@lo:700: 40000000:02000000:0.0:1787599266.253232:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1787599266.253337:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787599266.253543:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787599266.253721:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787599266.253917:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787599266.254099:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787599266.254227:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:2.0:1787599266.254303:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aacbe596 going to sleep for 11 seconds 00100000:10000000:3.0:1787599266.254508:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787599266.254648:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787599266.254784:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787599266.255171:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787599266.255324:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787599266.257710:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1787599266.259808:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1787599266.259980:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a51a7d8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854336:12345-0@lo:1000: Request processed in 7028us (7071us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787599266.259991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1787599266.260489:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787599266.260493:0:7474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787599266.260506:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2bd7f77 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854336:0@lo:1000: 00000100:00100000:3.0:1787599266.260578:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854464:0@lo:1000: 00000100:00100000:3.0:1787599266.260612:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599266.260646:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 000000005eff07fc going to sleep for 11 seconds 00000100:00100000:1.0:1787599266.260716:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854464 00000100:00100000:1.0:1787599266.260724:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854464 00000100:00100000:1.0:1787599266.260828:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599266.260835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047395b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854464:12345-0@lo:1000: 00000100:00100000:1.0:1787599266.260908:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047395b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1874433577854464:12345-0@lo:1000: Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599266.260915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599266.260954:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1874433577854464:0@lo:1000: 00000040:00080000:3.0:1787599266.260970:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787599266.260997:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003bf57fee with version 1 00000004:00080000:0.0:1787599266.261918:0:7463:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000091631aa3 version 1 rpc_version 1 00000020:00100000:0.0:1787599266.261946:0:7463:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787599266.261955:0:7463:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000238eb3ea x1874433577854720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599266.261974:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1874433577854720:0@lo:1000: 00000100:00100000:0.0:1787599266.262032:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599266.262069:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ed5098e going to sleep for 11 seconds 00000100:00100000:2.0:1787599266.262236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854720 00000100:00100000:2.0:1787599266.262244:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854720 00000100:00100000:2.0:1787599266.262280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599266.262287:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf33c10b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1874433577854720:12345-0@lo:1000: 00000001:00080000:0.0:1787599266.263955:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787599266.264899:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1441c73988 00100000:10000000:0.0:1787599266.264911:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:0.0:1787599266.266574:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787599266.266979:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf33c10b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1874433577854720:12345-0@lo:1000: Request processed in 4688us (4943us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787599266.266992:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1787599266.267155:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787599266.267161:0:7463:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787599266.267182:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1874433577854720:0@lo:1000: 00000020:01000004:0.0:1787599266.267263:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787599266.267292:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787599266.267312:0:7449:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787599266.267339:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1787599266.267817:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599266.267894:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:0.0:1787599266.276932:0:7449:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599266.277981:0:7449:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1787599266.297272:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599266.301283:0:7473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599266.301361:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787599266.301365:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787599267.045061:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599268.069136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599269.092945:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599270.117006:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599270.577394:0:7719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787599271.149945:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787599271.436730:0:7771:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599271.436962:0:7771:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787599271.463040:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021e660f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577854848:0@lo:41: 00000100:00100000:2.0:1787599271.463120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599271.463209:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854848 00000100:00100000:2.0:1787599271.463217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854848 00000100:00100000:2.0:1787599271.463263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599271.463271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000704d493f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577854848:12345-0@lo:41: 00000004:00000024:2.0:1787599271.463311:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787599271.463374:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000704d493f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577854848:12345-0@lo:41: Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599271.463381:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599271.463424:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021e660f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577854848:0@lo:41: 00000100:00100000:1.0:1787599271.464007:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577854976:0@lo:400: 00000100:00100000:1.0:1787599271.464051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599271.464094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599271.464100:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e29d9b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577855104:0@lo:400: 00000100:00100000:1.0:1787599271.464125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599271.464154:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577854976 00000100:00100000:1.0:1787599271.464159:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577854976 00000100:00100000:1.0:1787599271.464188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599271.464194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3f8277d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:3645:x1874433577854976:12345-0@lo:400: 00000100:00100000:1.0:1787599271.464226:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3f8277d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:3645:x1874433577854976:12345-0@lo:400: Request processed in 33us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599271.464232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599271.464261:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000238eb3ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577854976:0@lo:400: 00000100:00100000:2.0:1787599271.464641:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000725ace10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577855232:0@lo:400: 00000100:00100000:2.0:1787599271.464673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599271.464768:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855104 00000100:00100000:1.0:1787599271.464772:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855104 00000100:00100000:1.0:1787599271.464826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855232 00000100:00100000:1.0:1787599271.464829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855232 00000100:00100000:1.0:1787599271.464855:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599271.464861:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb1d5947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577855104:12345-0@lo:400: 00000100:00100000:1.0:1787599271.464900:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb1d5947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577855104:12345-0@lo:400: Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599271.464906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599271.464918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599271.464923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021e660f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577855232:12345-0@lo:400: 00000100:00100000:1.0:1787599271.464948:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021e660f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577855232:12345-0@lo:400: Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599271.464953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787599271.464975:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008e29d9b8 x1874433577855104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599271.465000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e29d9b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577855104:0@lo:400: 00010000:00080000:2.0:1787599271.465074:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000725ace10 x1874433577855232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599271.465083:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000725ace10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577855232:0@lo:400: 00010000:00010000:1.0:1787599272.166013:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787599272.998312:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599272.998321:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3812cf000 from 4 10000000:01000000:0.0:1787599272.998326:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599272.998376:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599272.998389:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599272.998417:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599272.998452:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855360:0@lo:101: 00000100:00100000:0.0:1787599272.998524:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599272.998602:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e2ce66 going to sleep for 11 seconds 00000100:00100000:1.0:1787599272.998723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855360 00000100:00100000:1.0:1787599272.998731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855360 00000100:00100000:1.0:1787599272.998844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787599272.998854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fc2a982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:6517:x1874433577855360:12345-0@lo:101: 00010000:00010000:1.0:1787599272.998867:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599272.998881:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000770672d6/0x5d2988b0929cefaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cefa3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599272.998902:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000770672d6/0x5d2988b0929cefaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599272.998911:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000770672d6/0x5d2988b0929cefaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599272.998918:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000770672d6, rc 0) 00000100:00100000:1.0:1787599272.998963:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fc2a982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:6517:x1874433577855360:12345-0@lo:101: Request processed in 110us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599272.998969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599272.999410:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855360:0@lo:101: 00010000:00010000:0.0:1787599272.999426:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599272.999445:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599272.999497:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855488:0@lo:256: 00000100:00100000:0.0:1787599272.999532:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599272.999565:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e2ce66 going to sleep for 11 seconds 00000100:00100000:2.0:1787599272.999690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855488 00000100:00100000:2.0:1787599272.999696:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855488 00000100:00100000:2.0:1787599272.999740:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599272.999764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de96d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:6517:x1874433577855488:12345-0@lo:256: 20000000:01000000:2.0:1787599272.999780:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599272.999832:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599272.999835:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787599272.999928:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de96d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:6517:x1874433577855488:12345-0@lo:256: Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599272.999936:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599273.000062:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855488:0@lo:256: 10000000:01000000:0.0:1787599273.000125:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599273.000132:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.000145:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000fb517f32/0x5d2988b0929cefa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599273.000154:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787599273.000156:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3707b1000 from 21 10000000:01000000:0.0:1787599273.000163:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599273.000180:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.000186:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.000193:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599273.000204:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855616:0@lo:101: 00000100:00100000:0.0:1787599273.000552:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.000585:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e2ce66 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.000655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855616 00000100:00100000:3.0:1787599273.000660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855616 00000100:00100000:3.0:1787599273.000696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787599273.000704:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e7fbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:6517:x1874433577855616:12345-0@lo:101: 00010000:00010000:3.0:1787599273.000712:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599273.000723:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cefb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cefb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.000741:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cefb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.000762:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2b97fe8/0x5d2988b0929cefb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.000770:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2b97fe8, rc 0) 00000100:00100000:3.0:1787599273.000840:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e7fbe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577855616:12345-0@lo:101: Request processed in 138us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.000847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787599273.001032:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855616:0@lo:101: 00010000:00010000:0.0:1787599273.001043:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.001050:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599273.001121:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855744:0@lo:501: 00000100:00100000:0.0:1787599273.001153:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.001178:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e2ce66 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.001545:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855744 00000100:00100000:3.0:1787599273.001551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855744 00000100:00100000:3.0:1787599273.001583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787599273.001589:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068c26858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577855744:12345-0@lo:501: 00000100:00100000:3.0:1787599273.001709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068c26858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577855744:12345-0@lo:501: Request processed in 120us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.001716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599273.001959:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855744:0@lo:501: 00000100:00100000:0.0:1787599273.001989:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855872:0@lo:503: 00000100:00100000:0.0:1787599273.002032:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.002061:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9e2ce66 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.002511:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577855872 00000100:00100000:3.0:1787599273.002517:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577855872 00000100:00100000:3.0:1787599273.002593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787599273.002601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df5afcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577855872:12345-0@lo:503: 00000100:00100000:3.0:1787599273.002699:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df5afcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577855872:12345-0@lo:503: Request processed in 100us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.002708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599273.002789:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577855872:0@lo:503: 00000100:00100000:0.0:1787599273.008161:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7823:1874433577856000:0@lo:502: 00000100:00100000:0.0:1787599273.008689:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.013527:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f329c72a going to sleep for 11 seconds 00000100:00100000:2.0:1787599273.016203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856000 00000100:00100000:2.0:1787599273.016875:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856000 00000100:00100000:2.0:1787599273.016951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599273.016960:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bba8cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7823:x1874433577856000:12345-0@lo:502: 00000100:00100000:2.0:1787599273.017527:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bba8cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7823:x1874433577856000:12345-0@lo:502: Request processed in 566us (8837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599273.017536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599273.017964:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7823:1874433577856000:0@lo:502: 00000100:00100000:0.0:1787599273.018034:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7823:1874433577856128:0@lo:502: 00000100:00100000:0.0:1787599273.018097:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.018423:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f329c72a going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.018556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856128 00000100:00100000:3.0:1787599273.018564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856128 00000100:00100000:3.0:1787599273.018600:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599273.018607:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099df87e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7823:x1874433577856128:12345-0@lo:502: 00000100:00100000:3.0:1787599273.018727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099df87e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:7823:x1874433577856128:12345-0@lo:502: Request processed in 121us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.018735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599273.019585:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7823:1874433577856128:0@lo:502: 00000040:00080000:0.0:1787599273.019618:0:7823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787599273.019916:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787599273.019940:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599273.019949:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.019958:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000000ebdc989/0x5d2988b0929cefb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599273.019968:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599273.019970:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3707b1000 from 4 10000000:01000000:2.0:1787599273.019973:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599273.020001:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.020008:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.020023:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599273.020039:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae7d9199 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856256:0@lo:101: 00000100:00100000:2.0:1787599273.020109:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.020384:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052a51878 going to sleep for 11 seconds 00000100:00100000:0.0:1787599273.020550:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856256 00000100:00100000:0.0:1787599273.020557:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856256 00000100:00100000:0.0:1787599273.020602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599273.020611:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039292fb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577856256:12345-0@lo:101: 00010000:00010000:0.0:1787599273.020623:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599273.020634:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1e6c230/0x5d2988b0929cefc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cefbf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.020655:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1e6c230/0x5d2988b0929cefc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.020664:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1e6c230/0x5d2988b0929cefc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.020672:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1e6c230, rc 0) 00000100:00100000:0.0:1787599273.020709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039292fb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577856256:12345-0@lo:101: Request processed in 99us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599273.020715:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599273.021715:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae7d9199 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856256:0@lo:101: 00010000:00010000:0.0:1787599273.021734:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.021744:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599273.022057:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856384:0@lo:256: 00000100:00100000:0.0:1787599273.022561:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.022663:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7eaf1a3 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.030325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856384 00000100:00100000:3.0:1787599273.030342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856384 00000100:00100000:3.0:1787599273.030807:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599273.030818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dbd1e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577856384:12345-0@lo:256: 20000000:01000000:3.0:1787599273.030856:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599273.030879:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599273.030882:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787599273.031028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dbd1e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577856384:12345-0@lo:256: Request processed in 213us (8469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.031035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787599273.031125:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a2f8d28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856384:0@lo:256: 10000000:01000000:2.0:1787599273.031188:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599273.031196:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.031208:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000000ede4485/0x5d2988b0929cefbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599273.031217:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787599273.031219:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787599273.031222:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599273.031252:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.031271:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.031279:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599273.031295:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856512:0@lo:101: 00000100:00100000:2.0:1787599273.031329:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.036024:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052a51878 going to sleep for 11 seconds 00000100:00100000:0.0:1787599273.036692:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856512 00000100:00100000:0.0:1787599273.036703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856512 00000100:00100000:0.0:1787599273.036772:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599273.036782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d569a00a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577856512:12345-0@lo:101: 00010000:00010000:0.0:1787599273.036818:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599273.036852:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a8ec184/0x5d2988b0929cefd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cefcd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.036883:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a8ec184/0x5d2988b0929cefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.036894:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a8ec184/0x5d2988b0929cefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599273.036904:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a8ec184, rc 0) 00000100:00100000:0.0:1787599273.036982:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d569a00a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577856512:12345-0@lo:101: Request processed in 202us (5651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599273.036989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787599273.037423:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856512:0@lo:101: 00010000:00010000:2.0:1787599273.037441:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599273.037450:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599273.037516:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856640:0@lo:501: 00000100:00100000:2.0:1787599273.037552:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.037587:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052a51878 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.037649:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856640 00000100:00100000:3.0:1787599273.037654:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856640 00000100:00100000:3.0:1787599273.037679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787599273.037684:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9cc2f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577856640:12345-0@lo:501: 00000100:00100000:3.0:1787599273.038009:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9cc2f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577856640:12345-0@lo:501: Request processed in 324us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.038016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599273.038090:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856640:0@lo:501: 00000100:00100000:2.0:1787599273.038125:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856768:0@lo:503: 00000100:00100000:2.0:1787599273.038423:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.038462:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052a51878 going to sleep for 11 seconds 00000100:00100000:0.0:1787599273.041082:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856768 00000100:00100000:0.0:1787599273.041364:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856768 00000100:00100000:0.0:1787599273.041416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599273.041425:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3dd2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577856768:12345-0@lo:503: 00000100:00100000:0.0:1787599273.042656:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3dd2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577856768:12345-0@lo:503: Request processed in 1228us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599273.042667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599273.045711:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577856768:0@lo:503: 00000100:00100000:2.0:1787599273.046770:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7824:1874433577856896:0@lo:502: 00000100:00100000:2.0:1787599273.046897:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.046945:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c968620b going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.047013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577856896 00000100:00100000:3.0:1787599273.047020:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577856896 00000100:00100000:3.0:1787599273.047065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787599273.047078:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ea224b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:7824:x1874433577856896:12345-0@lo:502: 00000100:00100000:3.0:1787599273.047233:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ea224b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:7824:x1874433577856896:12345-0@lo:502: Request processed in 155us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.047240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787599273.047786:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7824:1874433577856896:0@lo:502: 00000020:01000000:2.0:1787599273.047838:0:7824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599273.047850:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599273.047853:0:7824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787599273.047857:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599273.047860:0:7824:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:2.0:1787599273.047884:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599273.047916:0:7824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000003cc72e05) 00000020:00000080:2.0:1787599273.047939:0:7824:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787599273.047945:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599273.048036:0:7824:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787599273.048040:0:7824:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787599273.048047:0:7824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cefe2 00010000:00080000:2.0:1787599273.048075:0:7824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000edecab68@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599273.050686:0:7824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787599273.058669:0:7824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599273.058685:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787599273.058729:0:7824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787599273.058752:0:7824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cefe9 00000100:00080000:1.0:1787599273.058762:0:7824:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599273.058767:0:7824:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000edecab68 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599273.059040:0:7824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ca1c9393 x1874433577857024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599273.059104:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca1c9393 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577857024:0@lo:38: 00000100:00100000:0.0:1787599273.059195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.059415:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857024 00000100:00100000:2.0:1787599273.059422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857024 00000100:00100000:2.0:1787599273.059470:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599273.059476:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8bada9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433577857024:12345-0@lo:38: 00010000:00080000:2.0:1787599273.059498:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1787599273.059530:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929ceff0 00000004:00100000:2.0:1787599273.059544:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787599273.059549:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787599273.059861:0:7824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787599273.059907:0:7824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:1.0:1787599273.060359:0:7824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599273.060365:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599273.060367:0:7824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787599273.060371:0:7824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599273.060375:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599273.060376:0:7824:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599273.060379:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599273.060381:0:7824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787599273.060407:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7824:1874433577857152:0@lo:502: 00000100:00100000:1.0:1787599273.060476:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.060507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857152 00000100:00100000:1.0:1787599273.060511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857152 00000100:00100000:1.0:1787599273.060542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599273.060550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040b5ed36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:7824:x1874433577857152:12345-0@lo:502: 00000100:00100000:1.0:1787599273.060652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040b5ed36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:7824:x1874433577857152:12345-0@lo:502: Request processed in 103us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599273.060661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599273.060698:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dc32474 going to sleep for 11 seconds 00000100:00100000:1.0:1787599273.060717:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:7824:1874433577857152:0@lo:502: 00000020:01000000:1.0:1787599273.060738:0:7824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599273.060742:0:7824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599273.060744:0:7824:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787599273.060746:0:7824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:1.0:1787599273.060929:0:7827:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000052876121 x1874433577857280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599273.060938:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7b92267 going to sleep for 0 seconds 00000020:01000000:1.0:1787599273.060971:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787599273.060994:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787599273.061002:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599273.061013:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000a05188c7/0x5d2988b0929cefcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599273.061022:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787599273.061025:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b34dcf99b8 from 1 10000000:01000000:1.0:1787599273.061028:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599273.061049:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599273.061056:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599273.061063:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599273.061074:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad81ad8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577857408:0@lo:101: 00000100:00100000:1.0:1787599273.061102:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.061131:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f5d58d going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.061477:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857408 00000100:00100000:3.0:1787599273.061483:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857408 00000100:00100000:3.0:1787599273.061521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599273.061529:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fa4e305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577857408:12345-0@lo:101: 00010000:00010000:3.0:1787599273.061538:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599273.061551:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038c23cdf/0x5d2988b0929ceffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929ceff7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.061572:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038c23cdf/0x5d2988b0929ceffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.061582:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038c23cdf/0x5d2988b0929ceffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599273.061598:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038c23cdf, rc 0) 00000100:00100000:3.0:1787599273.061629:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fa4e305 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577857408:12345-0@lo:101: Request processed in 101us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.061635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599273.061898:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599273.061908:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577857536:0@lo:400: 00000100:00100000:2.0:1787599273.061943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.061977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577857664:0@lo:400: 00000100:00100000:2.0:1787599273.062003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.062023:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599273.062027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000debe5c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577857792:0@lo:400: 00000100:00100000:2.0:1787599273.062047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599273.062145:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787599273.062152:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787599273.062176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857536 00000100:00100000:3.0:1787599273.062181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857536 00000100:00100000:2.0:1787599273.062583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857792 00000100:00100000:2.0:1787599273.062589:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857792 00000100:00100000:3.0:1787599273.062641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599273.062649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7d9199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577857536:12345-0@lo:400: 00000100:00100000:3.0:1787599273.062693:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7d9199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577857536:12345-0@lo:400: Request processed in 46us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599273.062700:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599273.062776:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad81ad8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577857408:0@lo:101: 00010000:00010000:1.0:1787599273.062807:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599273.062817:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599273.062896:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad81ad8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577857920:0@lo:501: 00000100:00100000:1.0:1787599273.062922:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.062943:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857920 00000100:00100000:1.0:1787599273.062947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857920 00000100:00100000:1.0:1787599273.062972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599273.062977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004311d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577857920:12345-0@lo:501: 00000100:00100000:1.0:1787599273.063043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004311d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577857920:12345-0@lo:501: Request processed in 66us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599273.063050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599273.063977:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f5d58d going to sleep for 11 seconds 00000100:00100000:1.0:1787599273.063998:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad81ad8c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577857920:0@lo:501: 10000000:01000000:1.0:1787599273.064031:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787599273.064038:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599273.064048:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000c4a2a132/0x5d2988b0929ceff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599273.064412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599273.064424:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577857792:12345-0@lo:400: 00000100:00100000:0.0:1787599273.064699:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857664 00000100:00100000:0.0:1787599273.064706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857664 00000100:00100000:2.0:1787599273.064904:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577857792:12345-0@lo:400: Request processed in 484us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599273.064911:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787599273.064949:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000540009fa x1874433577857536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599273.064962:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577857536:0@lo:400: 00010000:00080000:2.0:1787599273.064992:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000debe5c45 x1874433577857792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599273.065002:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000debe5c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577857792:0@lo:400: 00000100:00100000:1.0:1787599273.065733:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599273.065743:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2bd7f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577857664:12345-0@lo:400: 00000100:00100000:1.0:1787599273.065862:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2bd7f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577857664:12345-0@lo:400: Request processed in 121us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599273.065869:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599273.065920:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577857664:0@lo:400: 00000100:00080000:1.0:1787599273.071552:0:6525:0:(import.c:65:import_set_state_nolock()) 0000000082fb35c0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599273.071712:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8bada9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433577857024:12345-0@lo:38: Request processed in 12233us (12515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599273.071730:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599273.071882:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599273.071893:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787599273.071900:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787599273.071906:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787599273.071909:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000edecab68 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787599273.071929:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a7b92267): req@0000000052876121 x1874433577857280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599273.072110:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.072169:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7b92267 going to sleep for 11 seconds 00000100:00100000:2.0:1787599273.072522:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577857280 00000100:00100000:2.0:1787599273.072529:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577857280 00000100:00100000:2.0:1787599273.072580:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599273.072590:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad81ad8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577857280:12345-0@lo:1000: 00000100:00100000:2.0:1787599273.072670:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad81ad8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577857280:12345-0@lo:1000: Request processed in 81us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599273.072676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599273.072749:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577857280:0@lo:1000: 00000040:01000000:1.0:1787599273.072785:0:7827:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787599273.072848:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858048:0@lo:1000: 00000100:00100000:1.0:1787599273.072880:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.072904:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7b92267 going to sleep for 11 seconds 00000100:00100000:1.0:1787599273.072918:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858048 00000100:00100000:1.0:1787599273.072921:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858048 00000100:00100000:1.0:1787599273.072942:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599273.072947:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2e41f0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577858048:12345-0@lo:1000: 00000100:00100000:1.0:1787599273.073108:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2e41f0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577858048:12345-0@lo:1000: Request processed in 160us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599273.073125:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599273.073410:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858048:0@lo:1000: 00000100:00100000:1.0:1787599273.073449:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858176:0@lo:700: 00000100:00100000:1.0:1787599273.073475:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.073489:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000641e558a going to sleep for 11 seconds 00000100:00100000:2.0:1787599273.073598:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858176 00000100:00100000:2.0:1787599273.073603:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858176 00000100:00100000:2.0:1787599273.073637:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599273.073643:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a05d63f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577858176:12345-0@lo:700: 00000100:00100000:2.0:1787599273.073684:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a05d63f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577858176:12345-0@lo:700: Request processed in 41us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599273.073690:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599273.073758:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858176:0@lo:700: 00000100:00100000:1.0:1787599273.073969:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858304:0@lo:1000: 00000100:00100000:1.0:1787599273.074374:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599273.074445:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b193ca21 going to sleep for 11 seconds 00000100:00100000:3.0:1787599273.074574:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599273.074584:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577858432:0@lo:41: 00000100:00100000:3.0:1787599273.074617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599273.074722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca1c9393 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577857024:0@lo:38: 00000100:00100000:2.0:1787599273.075080:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858304 00000100:00100000:2.0:1787599273.075096:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858304 00000100:00100000:2.0:1787599273.075392:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858432 00000100:00100000:2.0:1787599273.075396:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858432 00000100:00100000:0.0:1787599273.075443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599273.075454:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010a6ab43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7827:x1874433577858304:12345-0@lo:1000: 00000100:00100000:0.0:1787599273.075543:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010a6ab43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7827:x1874433577858304:12345-0@lo:1000: Request processed in 92us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599273.075549:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599273.075564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599273.075570:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035c7431c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577858432:12345-0@lo:41: 00000004:00000024:0.0:1787599273.075589:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787599273.075635:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035c7431c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577858432:12345-0@lo:41: Request processed in 66us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599273.075641:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599273.075707:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052876121 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858304:0@lo:1000: 00000004:00080000:3.0:1787599273.075759:0:7827:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000641e558a with version 0 00000020:00100000:3.0:1787599273.075776:0:7827:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787599273.075782:0:7827:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003b4a49d0 x1874433577858688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599273.075815:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b4a49d0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858688:0@lo:1000: 00000100:00100000:3.0:1787599273.075858:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599273.077205:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001a51233 going to sleep for 11 seconds 00000100:00100000:1.0:1787599273.077284:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858688 00000100:00100000:1.0:1787599273.077294:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858688 00000100:00100000:1.0:1787599273.077376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599273.077384:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b435bfd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7827:x1874433577858688:12345-0@lo:1000: 00000100:00100000:0.0:1787599273.080077:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b2026af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577858432:0@lo:41: 00000001:00080000:2.0:1787599273.083953:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787599273.083968:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787599273.084181:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b435bfd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7827:x1874433577858688:12345-0@lo:1000: Request processed in 6794us (8318us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787599273.084195:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1787599273.084468:0:7827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787599273.084474:0:7827:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787599273.084665:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b4a49d0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858688:0@lo:1000: 00000100:00100000:3.0:1787599273.085029:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b4a49d0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858816:0@lo:1000: 00000100:00100000:3.0:1787599273.085072:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599273.085117:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ebdc4cd4 going to sleep for 11 seconds 00000100:00100000:2.0:1787599273.085302:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577858816 00000100:00100000:2.0:1787599273.085327:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577858816 00000100:00100000:2.0:1787599273.085438:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599273.085447:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b454c46f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7827:x1874433577858816:12345-0@lo:1000: 00000100:00100000:2.0:1787599273.085923:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b454c46f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7827:x1874433577858816:12345-0@lo:1000: Request processed in 476us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599273.085932:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599273.085981:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b4a49d0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7827:1874433577858816:0@lo:1000: 00000040:00080000:3.0:1787599273.086008:0:7827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787599273.086044:0:7827:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000001a51233 with version 1 00000004:00080000:2.0:1787599273.086573:0:7825:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c968620b version 1 rpc_version 1 00000020:00100000:2.0:1787599273.086601:0:7825:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787599273.086608:0:7825:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f645ea53 x1874433577859072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599273.086627:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7825:1874433577859072:0@lo:1000: 00000100:00100000:2.0:1787599273.086674:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599273.086712:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089db478b going to sleep for 11 seconds 00000100:00100000:1.0:1787599273.086857:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859072 00000100:00100000:1.0:1787599273.086863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859072 00000100:00100000:1.0:1787599273.086905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599273.086913:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000debe5c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874433577859072:12345-0@lo:1000: 00000001:00080000:0.0:1787599273.090554:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787599273.090770:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000debe5c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874433577859072:12345-0@lo:1000: Request processed in 3854us (4091us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787599273.090786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787599273.090882:0:7825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787599273.090887:0:7825:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787599273.090908:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7825:1874433577859072:0@lo:1000: 00000040:00080000:3.0:1787599273.091941:0:7827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599273.092035:0:7827:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787599273.092041:0:7827:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787599273.190638:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599274.232725:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787599274.521260:0:7879:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599274.521547:0:7879:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787599275.242944:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599275.648365:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea0fa8d90 20000000:00000080:3.0:1787599275.648384:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b3778d7400 uarg=0000000000000000 20000000:01000000:3.0:1787599275.648433:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787599275.648442:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787599275.648448:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787599275.648534:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787599275.648547:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787599275.655157:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599275.655438:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787599275.655477:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787599275.655493:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787599275.655509:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599275.655531:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.655563:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.655571:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.655578:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.655704:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.655718:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 17 pid: 6514 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599275.655732:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874433577859200:0@lo:104: 00000100:00100000:2.0:1787599275.655850:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599275.656046:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.656054:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599275.656064:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874433577859328:0@lo:104: 00000100:00100000:2.0:1787599275.656084:0:7927:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025f5a6f7 going to sleep for 11 seconds 00000100:00100000:0.0:1787599275.657877:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787599275.657925:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599275.658026:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859200 00000100:00100000:0.0:1787599275.658038:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859200 00000100:00100000:2.0:1787599275.661287:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859328 00000100:00100000:2.0:1787599275.661301:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859328 00000100:00100000:2.0:1787599275.661358:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599275.661368:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009274d896 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:7927:x1874433577859200:12345-0@lo:104: 00010000:00010000:2.0:1787599275.661401:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.661560:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599275.661566:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009274d896 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:7927:x1874433577859200:12345-0@lo:104: Request processed in 199us (5716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599275.661574:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787599275.661709:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599275.661716:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.661725:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3cb88f4 already unused, calling callback (00000000eeb26065) 10000000:00010000:1.0:1787599275.661728:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.661736:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599275.661743:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599275.661749:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599275.661825:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.661840:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599275.661859:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.661866:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000d3cb88f4/0x5d2988b0929cef6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef72 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.661883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599275.661885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599275.661886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599275.661910:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577859456:0@lo:103: 00000100:00100000:1.0:1787599275.661954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599275.662016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859456 00000100:00100000:1.0:1787599275.662020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859456 00010000:00010000:1.0:1787599275.662041:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 18 pid: 6514 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599275.662065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599275.662072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e76e751b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3648:x1874433577859456:12345-0@lo:103: 00010000:00010000:1.0:1787599275.662083:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599275.662087:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 18 pid: 6514 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662097:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 18 pid: 6514 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662114:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599275.662139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e76e751b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3648:x1874433577859456:12345-0@lo:103: Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599275.662152:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599275.662190:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577859456:0@lo:103: 00000100:00100000:2.0:1787599275.662258:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599275.662266:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d974125 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:7927:x1874433577859328:12345-0@lo:104: 00010000:00010000:2.0:1787599275.662273:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.662317:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599275.662322:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d974125 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:7927:x1874433577859328:12345-0@lo:104: Request processed in 59us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599275.662328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787599275.662465:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599275.662470:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662476:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c0de75a already unused, calling callback (00000000eeb26065) 10000000:00010000:1.0:1787599275.662478:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662484:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599275.662490:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599275.662495:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599275.662519:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662524:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599275.662536:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662541:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000002c0de75a/0x5d2988b0929cee7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cee84 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599275.662555:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599275.662557:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599275.662565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599275.662719:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577859584:0@lo:103: 00000100:00100000:2.0:1787599275.662746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599275.663850:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859584 00000100:00100000:0.0:1787599275.663862:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859584 00010000:00010000:0.0:1787599275.663897:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599275.663931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599275.663938:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a120bee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3645:x1874433577859584:12345-0@lo:103: 00010000:00010000:0.0:1787599275.663950:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599275.663954:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.663965:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.663982:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.663989:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664005:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664023:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664029:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664034:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664040:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000296e79be already unused, calling callback (000000009558233a) 00010000:00010000:0.0:1787599275.664043:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664050:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664059:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599275.664070:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599275.664134:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a120bee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3645:x1874433577859584:12345-0@lo:103: Request processed in 197us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599275.664141:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599275.664290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060b67097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577859584:0@lo:103: 00010000:00010000:3.0:1787599275.665768:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085a97ad8/0x5d2988b0929cef72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cef6b expref: 17 pid: 6514 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599275.665986:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874433577859200:0@lo:104: 00010000:00010000:2.0:1787599275.666077:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008aa2d25b/0x5d2988b0929cee84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cee7d expref: 16 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599275.666089:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874433577859328:0@lo:104: 00010000:00010000:2.0:1787599275.666111:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.666121:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.666144:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599275.666149:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000296e79be/0x5d2988b0929cf005 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599276.261446:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599276.582093:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577859712:0@lo:41: 00000100:00100000:3.0:1787599276.582187:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599276.583494:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859712 00000100:00100000:2.0:1787599276.583507:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859712 00000100:00100000:2.0:1787599276.583573:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599276.583581:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b4a49d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577859712:12345-0@lo:41: 00000004:00000024:2.0:1787599276.583616:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787599276.583693:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b4a49d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577859712:12345-0@lo:41: Request processed in 112us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599276.583700:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599276.583874:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000540009fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577859712:0@lo:41: 00010000:00010000:1.0:1787599277.289083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599278.118527:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee0df662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577859840:0@lo:41: 00000100:00100000:1.0:1787599278.118607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599278.122156:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577859968:0@lo:400: 00000100:00100000:0.0:1787599278.122245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599278.122307:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859840 00000100:00100000:0.0:1787599278.122315:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859840 00000100:00100000:0.0:1787599278.122358:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599278.122365:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd565c97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577859840:12345-0@lo:41: 00000004:00000024:0.0:1787599278.122410:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787599278.122575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577859968 00000100:00100000:3.0:1787599278.122579:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577859968 00000100:00100000:3.0:1787599278.122671:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599278.122678:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d58cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3648:x1874433577859968:12345-0@lo:400: 00000100:00100000:3.0:1787599278.122719:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d58cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3648:x1874433577859968:12345-0@lo:400: Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599278.122726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787599278.126543:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec802e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577860096:0@lo:400: 00000100:00100000:2.0:1787599278.126625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599278.126664:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599278.126670:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a74f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577860224:0@lo:400: 00000100:00100000:2.0:1787599278.126697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599278.126732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860096 00000100:00100000:2.0:1787599278.126740:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860096 00000100:00100000:2.0:1787599278.126821:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599278.126830:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8b23ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577860096:12345-0@lo:400: 00000100:00100000:2.0:1787599278.126883:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8b23ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577860096:12345-0@lo:400: Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599278.126890:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599278.126913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860224 00000100:00100000:2.0:1787599278.126930:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860224 00000100:00100000:2.0:1787599278.126952:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599278.126957:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000540009fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577860224:12345-0@lo:400: 00000100:00100000:2.0:1787599278.126990:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000540009fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577860224:12345-0@lo:400: Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599278.126996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599278.127031:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a74f4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577860224:0@lo:400: 00010000:00080000:2.0:1787599278.127042:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002ec802e0 x1874433577860096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599278.127053:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec802e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577860096:0@lo:400: 00000100:00100000:0.0:1787599278.134858:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd565c97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577859840:12345-0@lo:41: Request processed in 12485us (16243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599278.134873:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599278.134946:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f645ea53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577859968:0@lo:400: 00000100:00100000:0.0:1787599278.134970:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599278.134980:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577860352:0@lo:400: 00000100:00100000:0.0:1787599278.135045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599278.141974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860352 00000100:00100000:2.0:1787599278.141991:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860352 00000100:00100000:2.0:1787599278.142052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599278.142063:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000566add7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577860352:12345-0@lo:400: 00000100:00100000:2.0:1787599278.142169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000566add7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577860352:12345-0@lo:400: Request processed in 108us (7123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599278.142177:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787599278.142261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000083685147 x1874433577860352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599278.142276:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577860352:0@lo:400: 00000100:00100000:1.0:1787599278.143412:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee0df662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577859840:0@lo:41: 00010000:00010000:2.0:1787599278.312940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599279.339195:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599280.358399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787599281.188941:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599281.188950:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3812cf000 from 1 10000000:01000000:0.0:1787599281.188955:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599281.189748:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000085a97ad8/0x5d2988b0929cf00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599281.189773:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000085a97ad8/0x5d2988b0929cf00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599281.189786:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000085a97ad8/0x5d2988b0929cf00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599281.189862:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005146c673 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860480:0@lo:101: 00000100:00100000:0.0:1787599281.189945:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599281.192908:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 000000004efbde8a going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.194972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860480 00000100:00100000:2.0:1787599281.194987:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860480 00000100:00100000:2.0:1787599281.195473:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599281.195485:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062210fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577860480:12345-0@lo:101: 00010000:00010000:2.0:1787599281.195504:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599281.195527:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000296e79be/0x5d2988b0929cf013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf00c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.195556:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000296e79be/0x5d2988b0929cf013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.195567:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000296e79be/0x5d2988b0929cf013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.195576:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000296e79be, rc 0) 00000100:00100000:2.0:1787599281.195669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062210fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577860480:12345-0@lo:101: Request processed in 186us (5726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.195676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599281.195783:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005146c673 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860480:0@lo:101: 00010000:00010000:1.0:1787599281.195819:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000085a97ad8/0x5d2988b0929cf00c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599281.195829:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000085a97ad8/0x5d2988b0929cf00c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599281.195917:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860608:0@lo:501: 00000100:00100000:1.0:1787599281.195952:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599281.211144:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d982d2ad going to sleep for 11 seconds 00000100:00100000:3.0:1787599281.214869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860608 00000100:00100000:3.0:1787599281.214885:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860608 00000100:00100000:3.0:1787599281.215400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599281.215409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709acd52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577860608:12345-0@lo:501: 00000100:00100000:3.0:1787599281.215596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709acd52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577860608:12345-0@lo:501: Request processed in 187us (19643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599281.215604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599281.226042:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860608:0@lo:501: 00000100:00100000:1.0:1787599281.226092:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860736:0@lo:503: 00000100:00100000:1.0:1787599281.226150:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599281.226184:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d982d2ad going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.231389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860736 00000100:00100000:2.0:1787599281.231403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860736 00000100:00100000:2.0:1787599281.231444:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599281.231449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ba34535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577860736:12345-0@lo:503: 00000100:00100000:2.0:1787599281.231619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ba34535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577860736:12345-0@lo:503: Request processed in 169us (5468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.231625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599281.231672:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326177b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577860736:0@lo:503: 00000100:00100000:2.0:1787599281.232138:0:8185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8185:1874433577860864:0@lo:502: 00000100:00100000:2.0:1787599281.232174:0:8185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.232191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860864 00000100:00100000:2.0:1787599281.232194:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860864 00000100:00100000:2.0:1787599281.232206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599281.232209:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c633b14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8185:x1874433577860864:12345-0@lo:502: 00000100:00100000:2.0:1787599281.232260:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c633b14c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8185:x1874433577860864:12345-0@lo:502: Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.233345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599281.233388:0:8185:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cd00340 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.233402:0:8185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083685147 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8185:1874433577860864:0@lo:502: 00000020:01000000:2.0:1787599281.233423:0:8185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599281.233431:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599281.233432:0:8185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787599281.233439:0:8185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3812cf000 00000020:00000080:2.0:1787599281.233440:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787599281.233478:0:8185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8185:1874433577860992:0@lo:502: 00000100:00100000:2.0:1787599281.233520:0:8185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.233543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577860992 00000100:00100000:2.0:1787599281.233547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577860992 00000100:00100000:2.0:1787599281.233563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599281.233568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8185:x1874433577860992:12345-0@lo:502: 00000100:00100000:2.0:1787599281.233624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8185:x1874433577860992:12345-0@lo:502: Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.233629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599281.233648:0:8185:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352936cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.233659:0:8185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8185:1874433577860992:0@lo:502: 00000020:01000000:2.0:1787599281.233676:0:8185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599281.233681:0:8185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599281.233682:0:8185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787599281.233686:0:8185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787599281.233747:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787599281.233784:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599281.233806:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.233823:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599281.233831:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599281.233833:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3707b1000 from 1 10000000:01000000:2.0:1787599281.233835:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599281.233855:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.233860:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.233866:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599281.233873:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861120:0@lo:101: 00000100:00100000:2.0:1787599281.233895:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.233908:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352936cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.235374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861120 00000100:00100000:2.0:1787599281.235386:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861120 00000100:00100000:2.0:1787599281.235421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599281.235429:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577861120:12345-0@lo:101: 00010000:00010000:2.0:1787599281.235442:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599281.235470:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf01a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.235497:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.235519:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.235528:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7600, rc 0) 00000100:00100000:2.0:1787599281.235574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577861120:12345-0@lo:101: Request processed in 147us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.235579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599281.235608:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861120:0@lo:101: 00010000:00010000:2.0:1787599281.235618:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.235625:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599281.235672:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861248:0@lo:501: 00000100:00100000:2.0:1787599281.235699:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.235713:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352936cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.235722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861248 00000100:00100000:2.0:1787599281.235725:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861248 00000100:00100000:2.0:1787599281.235741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599281.235747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577861248:12345-0@lo:501: 00000100:00100000:2.0:1787599281.235874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577861248:12345-0@lo:501: Request processed in 127us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.235879:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599281.235903:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861248:0@lo:501: 00000100:00100000:2.0:1787599281.239050:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861376:0@lo:503: 00000100:00100000:2.0:1787599281.239133:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.239171:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.239190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861376 00000100:00100000:2.0:1787599281.239196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861376 00000100:00100000:2.0:1787599281.239238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599281.239247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577861376:12345-0@lo:503: 00000100:00100000:2.0:1787599281.240396:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577861376:12345-0@lo:503: Request processed in 1143us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.240407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787599281.240664:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577861376:0@lo:503: 00000100:00100000:1.0:1787599281.247781:0:8186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8186:1874433577861504:0@lo:502: 00000100:00100000:1.0:1787599281.247891:0:8186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599281.247928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861504 00000100:00100000:1.0:1787599281.247936:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861504 00000100:00100000:1.0:1787599281.247986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599281.247996:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8186:x1874433577861504:12345-0@lo:502: 00000100:00100000:1.0:1787599281.248125:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8186:x1874433577861504:12345-0@lo:502: Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599281.248133:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599281.248184:0:8186:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599281.248207:0:8186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8186:1874433577861504:0@lo:502: 00000020:01000000:1.0:1787599281.248237:0:8186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599281.248249:0:8186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599281.248251:0:8186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599281.248260:0:8186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3707b1000 00000020:00000080:1.0:1787599281.248557:0:8186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599281.248583:0:8186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8186:1874433577861632:0@lo:502: 00000100:00100000:1.0:1787599281.248618:0:8186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599281.248632:0:8186:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599281.248706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861632 00000100:00100000:2.0:1787599281.248711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861632 00000100:00100000:2.0:1787599281.248744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599281.248763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8186:x1874433577861632:12345-0@lo:502: 00000100:00100000:2.0:1787599281.248862:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8186:x1874433577861632:12345-0@lo:502: Request processed in 110us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.248869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599281.249100:0:8186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8186:1874433577861632:0@lo:502: 00000020:01000000:1.0:1787599281.249120:0:8186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599281.249125:0:8186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599281.249127:0:8186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787599281.249130:0:8186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787599281.250619:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787599281.250644:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599281.250661:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599281.250676:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599281.382017:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599281.702097:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599281.702123:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577861760:0@lo:41: 00000100:00100000:2.0:1787599281.702194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.702270:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861760 00000100:00100000:2.0:1787599281.702291:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861760 00000100:00100000:2.0:1787599281.702350:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599281.702359:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577861760:12345-0@lo:41: 00000004:00000024:2.0:1787599281.702392:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787599281.702447:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577861760:12345-0@lo:41: Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599281.702455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599281.702629:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577861760:0@lo:41: 00010000:00010000:1.0:1787599282.416094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599283.237056:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599283.237082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577861888:0@lo:41: 00000100:00100000:1.0:1787599283.237147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599283.237380:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577861888 00000100:00100000:0.0:1787599283.237387:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577861888 00000100:00100000:0.0:1787599283.237441:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787599283.237450:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577861888:12345-0@lo:41: 00000004:00000024:0.0:1787599283.237496:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787599283.237546:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577861888:12345-0@lo:41: Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599283.237552:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787599283.237592:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577861888:0@lo:41: 00000100:00100000:0.0:1787599283.238519:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577862144:0@lo:400: 00000100:00100000:0.0:1787599283.238565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599283.238595:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599283.238601:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577862272:0@lo:400: 00000100:00100000:0.0:1787599283.238626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599283.238657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862144 00000100:00100000:0.0:1787599283.238663:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862144 00000100:00100000:0.0:1787599283.238698:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599283.238706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577862144:12345-0@lo:400: 00000100:00100000:0.0:1787599283.238758:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577862144:12345-0@lo:400: Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599283.238764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599283.238890:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577862016:0@lo:400: 00000100:00100000:1.0:1787599283.239008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599283.239038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599283.239056:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577862400:0@lo:400: 00000100:00100000:1.0:1787599283.239080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599283.239107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862016 00000100:00100000:1.0:1787599283.239111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862016 00000100:00100000:1.0:1787599283.239139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787599283.239145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3646:x1874433577862016:12345-0@lo:400: 00000100:00100000:1.0:1787599283.239178:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3646:x1874433577862016:12345-0@lo:400: Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599283.239184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787599283.239212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862400 00000100:00100000:1.0:1787599283.239216:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862400 00000100:00100000:1.0:1787599283.240087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599283.240100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577862400:12345-0@lo:400: 00000100:00100000:1.0:1787599283.240147:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577862400:12345-0@lo:400: Request processed in 52us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599283.240153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787599283.240193:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b345e02a00 x1874433577862400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599283.240207:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577862400:0@lo:400: 00000100:00100000:1.0:1787599283.240217:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577862016:0@lo:400: 00000100:00100000:0.0:1787599283.240359:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862272 00000100:00100000:0.0:1787599283.240365:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862272 00000100:00100000:0.0:1787599283.240395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599283.240402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577862272:12345-0@lo:400: 00000100:00100000:0.0:1787599283.240437:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577862272:12345-0@lo:400: Request processed in 36us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599283.240443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599283.240470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577862272:0@lo:400: 00010000:00080000:0.0:1787599283.240482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b345e01f80 x1874433577862144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599283.240502:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577862144:0@lo:400: 00010000:00010000:3.0:1787599283.429712:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599284.454943:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599285.477259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787599285.992582:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787599285.992586:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787599285.992588:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787599285.992744:0:8427:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b3778e6800 00000020:01000004:3.0:1787599285.992759:0:8427:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787599285.992772:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787599285.992785:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96b3707b8000) 00000020:00000080:3.0:1787599285.992828:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787599286.036662:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787599286.036734:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787599286.073494:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787599286.073781:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787599286.073825:0:8427:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599286.073839:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929cf02f 00000020:01000004:2.0:1787599286.073847:0:8427:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787599286.073870:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599286.073874:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599286.073880:0:8427:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787599286.073885:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787599286.073897:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96b3706f3370) 00000020:00000080:2.0:1787599286.073908:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787599286.075450:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599286.075685:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599286.075693:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787599286.079640:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787599286.079652:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787599286.083856:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599286.083873:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787599286.086339:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599286.086541:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787599286.086549:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787599286.090643:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787599286.090659:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787599286.122732:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599286.123018:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599286.123025:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787599286.131159:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599286.131173:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787599286.140627:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599286.140643:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787599286.147608:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599286.147860:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787599286.147868:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787599286.153947:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787599286.153969:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787599286.294938:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599286.295153:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787599286.295160:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787599286.307859:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787599286.307876:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787599286.309732:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787599286.309763:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787599286.309770:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787599286.350415:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599286.350455:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787599286.350460:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599286.350462:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599286.350463:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599286.350465:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599286.350466:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599286.350467:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599286.350469:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599286.350470:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599286.350472:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599286.350473:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599286.350475:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599286.350478:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787599286.350480:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599286.350482:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599286.350483:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599286.350484:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599286.350485:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599286.350486:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599286.350487:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599286.350488:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599286.350489:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599286.350490:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599286.350491:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599286.350519:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787599286.350536:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577862528:0@lo:253: 00000100:00100000:2.0:1787599286.350616:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.350724:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b346771840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599286.352745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862528 00000100:00100000:1.0:1787599286.352758:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862528 00000100:00100000:2.0:1787599286.352911:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599286.352922:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8427:x1874433577862528:12345-0@lo:253: 20000000:01000000:2.0:1787599286.352956:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787599286.352961:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787599286.352966:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787599286.352970:0:6515:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787599286.353250:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599286.353391:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787599286.353406:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787599286.353423:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787599286.353429:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787599286.353458:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787599286.353476:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787599286.353560:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787599286.353575:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:2.0:1787599286.353578:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787599286.353593:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787599286.353599:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787599286.353613:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787599286.353619:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1787599286.353631:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787599286.353637:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787599286.353650:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787599286.353666:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787599286.353753:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787599286.353764:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:2.0:1787599286.353766:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787599286.353780:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787599286.353785:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787599286.353826:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787599286.353832:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1787599286.353846:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787599286.353852:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787599286.353864:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787599286.353879:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787599286.354250:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787599286.354263:0:6515:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:2.0:1787599286.354272:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787599286.354291:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787599286.354298:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787599286.354329:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787599286.354336:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1787599286.354351:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787599286.354357:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787599286.354371:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787599286.354387:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787599286.354401:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787599286.354404:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787599286.354408:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787599286.354450:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787599286.354453:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787599286.355548:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787599286.356277:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787599286.356303:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787599286.356317:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787599286.356329:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787599286.356332:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787599286.356737:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1787599286.356764:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1787599286.356780:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787599286.357406:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787599286.357428:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787599286.357440:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787599286.357449:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787599286.357451:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787599286.357887:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787599286.357910:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787599286.357923:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787599286.358055:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787599286.358071:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787599286.358082:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787599286.358089:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787599286.358091:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599286.363473:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599286.363521:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599286.363538:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787599286.363780:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1787599286.363837:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1787599286.363853:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1787599286.363879:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787599286.363900:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363918:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363926:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363933:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363941:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363948:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.363956:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.364000:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.364015:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.364032:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862656:0@lo:104: 00000100:00100000:3.0:1787599286.364110:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599286.364162:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.364177:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.364186:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862784:0@lo:104: 00000100:00100000:3.0:1787599286.364534:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599286.364604:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.364613:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.364622:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862912:0@lo:104: 00000100:00100000:3.0:1787599286.364645:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599286.365110:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.365119:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.365128:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577863040:0@lo:104: 00000100:00100000:3.0:1787599286.365149:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599286.365290:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862656 00000100:00100000:0.0:1787599286.365297:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862656 00000100:00100000:0.0:1787599286.365335:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862784 00000100:00100000:0.0:1787599286.365338:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862784 00000100:00100000:0.0:1787599286.365349:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577862912 00000100:00100000:0.0:1787599286.365351:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577862912 00000100:00100000:0.0:1787599286.365363:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599286.365371:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577862656:12345-0@lo:104: 00010000:00010000:0.0:1787599286.365383:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.365489:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599286.365496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577862656:12345-0@lo:104: Request processed in 126us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.365503:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599286.365520:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599286.365527:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6515:x1874433577862784:12345-0@lo:104: 00010000:00010000:0.0:1787599286.365533:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.365630:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.365639:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.365647:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577863168:0@lo:104: 00000100:00100000:3.0:1787599286.365674:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.365684:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599286.365714:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862656:0@lo:104: 00000100:00100000:3.0:1787599286.365725:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862784:0@lo:104: 00000100:00100000:2.0:1787599286.365902:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787599286.365911:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787599286.368728:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863040 00000100:00100000:3.0:1787599286.368743:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863040 00000100:00100000:3.0:1787599286.368828:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787599286.368837:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863168 00000100:00100000:3.0:1787599286.368840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863168 00000100:00100000:2.0:1787599286.369241:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599286.369265:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6515:x1874433577862912:12345-0@lo:104: 00010000:00010000:2.0:1787599286.369285:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369427:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599286.369434:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369443:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341496000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599286.369446:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369455:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599286.369461:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599286.369466:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599286.369523:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369536:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599286.369557:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369564:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341496000/0x5d2988b0929ceff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929ceffe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369575:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599286.369579:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369584:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599286.369587:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369592:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599286.369597:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599286.369602:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599286.369615:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369620:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599286.369635:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369641:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152a000/0x5d2988b0929cefcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefd4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369657:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599286.369660:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369665:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599286.369667:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369673:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599286.369679:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599286.369684:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599286.369696:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369702:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599286.369717:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369722:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340031400/0x5d2988b0929cefb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.369732:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599286.369733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599286.369735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599286.369752:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577863296:0@lo:103: 00000100:00100000:1.0:1787599286.369816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.369869:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577863424:0@lo:103: 00000100:00100000:1.0:1787599286.369909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.369929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599286.369935:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577863552:0@lo:103: 00000100:00100000:1.0:1787599286.369957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.369988:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863296 00000100:00100000:1.0:1787599286.369993:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863296 00010000:00010000:1.0:1787599286.370015:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 19 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599286.370029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863424 00000100:00100000:1.0:1787599286.370033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863424 00010000:00010000:1.0:1787599286.370042:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 20 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599286.370050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863552 00000100:00100000:1.0:1787599286.370052:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863552 00010000:00010000:1.0:1787599286.370060:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599286.370071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599286.370077:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3646:x1874433577863296:12345-0@lo:103: 00010000:00010000:1.0:1787599286.370087:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599286.370093:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370103:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370126:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1a00/0x5d2988b0929ceffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929ceff7 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370139:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599286.370167:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3646:x1874433577863296:12345-0@lo:103: Request processed in 90us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.370175:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599286.370192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599286.370198:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:3647:x1874433577863424:12345-0@lo:103: 00010000:00010000:1.0:1787599286.370206:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599286.370211:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 19 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370219:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 19 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370229:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031a00/0x5d2988b0929cefd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cefcd expref: 19 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370237:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599286.370262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3647:x1874433577863424:12345-0@lo:103: Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.370268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599286.370280:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599286.370286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3647:x1874433577863552:12345-0@lo:103: 00010000:00010000:1.0:1787599286.370293:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599286.370298:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 17 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370313:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 17 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.370322:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599286.370344:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3647:x1874433577863552:12345-0@lo:103: Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.370349:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599286.370385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577863296:0@lo:103: 00000100:00100000:1.0:1787599286.370411:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577863552:0@lo:103: 00000100:00100000:1.0:1787599286.370417:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577863424:0@lo:103: 00010000:00010000:3.0:1787599286.370840:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cefb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cefb1 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.370852:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577862912:0@lo:104: 00010000:00010000:0.0:1787599286.370945:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787599286.370954:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:6515:x1874433577862784:12345-0@lo:104: Request processed in 5427us (6420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.370963:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787599286.371034:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599286.371047:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599286.371056:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577863040:12345-0@lo:104: 00010000:00010000:3.0:1787599286.371065:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371116:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599286.371121:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:6515:x1874433577863040:12345-0@lo:104: Request processed in 68us (5972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.371126:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599286.371138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599286.371144:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6515:x1874433577863168:12345-0@lo:104: 00010000:00010000:3.0:1787599286.371151:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371201:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787599286.371206:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6515:x1874433577863168:12345-0@lo:104: Request processed in 63us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.371213:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787599286.371228:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599286.371233:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371240:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ae00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599286.371243:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371253:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599286.371259:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599286.371264:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599286.371288:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371294:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599286.371309:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371315:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152ae00/0x5d2988b0929cef79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef80 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371334:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599286.371337:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371342:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599286.371345:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371352:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599286.371358:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599286.371362:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599286.371376:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371381:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599286.371386:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371392:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cef02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cef09 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371406:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599286.371407:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599286.371409:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599286.371418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577863680:0@lo:103: 00000100:00100000:3.0:1787599286.371460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.371480:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599286.371485:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577863808:0@lo:103: 00000100:00100000:3.0:1787599286.371518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.371540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863680 00000100:00100000:3.0:1787599286.371544:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863680 00010000:00010000:3.0:1787599286.371558:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.371575:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863808 00000100:00100000:3.0:1787599286.371577:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863808 00010000:00010000:3.0:1787599286.371585:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 17 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.371595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599286.371600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3645:x1874433577863680:12345-0@lo:103: 00010000:00010000:3.0:1787599286.371607:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599286.371611:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 17 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371620:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 17 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371631:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599286.371652:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3645:x1874433577863680:12345-0@lo:103: Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.371658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599286.371667:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599286.371672:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3645:x1874433577863808:12345-0@lo:103: 00010000:00010000:3.0:1787599286.371685:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599286.371690:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 16 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371699:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 16 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371722:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371730:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371742:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371749:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371756:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371763:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371769:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d1200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599286.371772:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371778:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371819:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.371828:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599286.371849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3645:x1874433577863808:12345-0@lo:103: Request processed in 176us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.371856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599286.371903:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577863808:0@lo:103: 00000100:00100000:3.0:1787599286.371910:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577863680:0@lo:103: 00010000:00010000:1.0:1787599286.372081:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599286.372144:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d0c00/0x5d2988b0929cef80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cef79 expref: 15 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599286.372154:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577863040:0@lo:104: 00010000:00010000:0.0:1787599286.372162:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a200/0x5d2988b0929cef09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cef02 expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599286.372170:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874433577863168:0@lo:104: 00010000:00010000:0.0:1787599286.372188:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.372240:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.372247:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.372253:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf03d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599286.372266:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1787599286.372749:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787599286.372759:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6515:x1874433577862912:12345-0@lo:104: Request processed in 3495us (8112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.372767:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787599286.373005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599286.376163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:8427:x1874433577862528:12345-0@lo:253: Request processed in 23234us (25537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.376177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599286.376356:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577862528:0@lo:253: 10000000:01000000:2.0:1787599286.376371:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787599286.376374:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599286.376376:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599286.376377:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599286.376378:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787599286.376380:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599286.376381:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599286.376382:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599286.376384:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787599286.376385:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599286.376387:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787599286.376405:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b3778e6800 from lustre-OST0000 10000000:01000000:2.0:1787599286.376461:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787599286.376464:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787599286.376473:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b34dcf99b8 local copy 10000000:01000000:2.0:1787599286.376478:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787599286.376516:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.376527:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.376537:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599286.376565:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577863936:0@lo:101: 00000100:00100000:2.0:1787599286.376603:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.376651:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f63180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.377006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577863936 00000100:00100000:0.0:1787599286.377014:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577863936 00000100:00100000:0.0:1787599286.377059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787599286.377068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+13:8427:x1874433577863936:12345-0@lo:101: 00010000:00010000:0.0:1787599286.377079:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599286.377093:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf04b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf044 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.377116:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf044 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.377126:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf044 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.377135:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:0.0:1787599286.377172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577863936:12345-0@lo:101: Request processed in 105us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.377177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787599286.377262:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577863936:0@lo:101: 00010000:00010000:2.0:1787599286.377275:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.377285:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599286.377372:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864064:0@lo:501: 00000100:00100000:2.0:1787599286.377414:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.377443:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f63180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.377553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864064 00000100:00100000:0.0:1787599286.377558:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864064 00000100:00100000:0.0:1787599286.377591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599286.377598:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577864064:12345-0@lo:501: 00000100:00100000:0.0:1787599286.377664:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577864064:12345-0@lo:501: Request processed in 66us (250us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599286.377672:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599286.378024:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864064:0@lo:501: 10000000:01000000:3.0:1787599286.378038:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787599286.378060:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787599286.378066:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.378074:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.378082:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.380451:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787599286.380489:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b3778e6800 10000000:01000000:3.0:1787599286.380499:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787599286.380506:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787599286.380523:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599286.380528:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787599286.380531:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599286.380570:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.380581:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.380592:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.380614:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864192:0@lo:101: 00000100:00100000:3.0:1787599286.380673:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.380728:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599286.380753:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864192 00000100:00100000:1.0:1787599286.380760:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864192 00000100:00100000:1.0:1787599286.380854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787599286.380863:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577864192:12345-0@lo:101: 00010000:00010000:1.0:1787599286.380874:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599286.380886:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf052 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.380923:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.380933:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.380942:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341496000, rc 0) 00000100:00100000:1.0:1787599286.380984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864192:12345-0@lo:101: Request processed in 122us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.380991:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599286.383626:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864192:0@lo:101: 00010000:00010000:3.0:1787599286.383654:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.383667:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.383844:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864320:0@lo:501: 00000100:00100000:3.0:1787599286.383912:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.383952:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.384118:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864320 00000100:00100000:0.0:1787599286.384125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864320 00000100:00100000:0.0:1787599286.384172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599286.384182:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864320:12345-0@lo:501: 00000100:00100000:0.0:1787599286.384329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864320:12345-0@lo:501: Request processed in 148us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.384337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599286.384516:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864320:0@lo:501: 00000100:00100000:3.0:1787599286.384542:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864448:0@lo:503: 00000100:00100000:3.0:1787599286.384582:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.384612:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.384734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864448 00000100:00100000:0.0:1787599286.384738:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864448 00000100:00100000:0.0:1787599286.384780:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599286.384787:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864448:12345-0@lo:503: 00000100:00100000:0.0:1787599286.384898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864448:12345-0@lo:503: Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.384905:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787599286.385054:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864448:0@lo:503: 00000040:00080000:3.0:1787599286.385335:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599286.385400:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864576:0@lo:502: 00000100:00100000:3.0:1787599286.385439:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.385473:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.385733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864576 00000100:00100000:0.0:1787599286.385738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864576 00000100:00100000:0.0:1787599286.385783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599286.385812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864576:12345-0@lo:502: 00000100:00100000:0.0:1787599286.385911:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864576:12345-0@lo:502: Request processed in 120us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.385918:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787599286.386056:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864576:0@lo:502: 00000040:00080000:1.0:1787599286.386266:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787599286.386305:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787599286.386320:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787599286.386333:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787599286.386345:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787599286.386357:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787599286.386571:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864704:0@lo:502: 00000100:00100000:1.0:1787599286.386614:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.386647:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.386679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864704 00000100:00100000:0.0:1787599286.386684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864704 00000100:00100000:0.0:1787599286.386725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599286.386734:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864704:12345-0@lo:502: 00010000:00010000:2.0:1787599286.387785:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599286.387812:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.387822:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599286.387826:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.387835:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599286.387842:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599286.387847:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787599286.396907:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864704:12345-0@lo:502: Request processed in 10161us (10280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.396921:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599286.397153:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864704:0@lo:502: 00000040:00080000:0.0:1787599286.397250:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787599286.397280:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:3.0:1787599286.398018:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.398029:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599286.398061:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.398069:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf04b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.398085:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599286.398100:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577864832:0@lo:103: 00000100:00100000:3.0:1787599286.398145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.398190:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864832 00000100:00100000:3.0:1787599286.398196:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864832 00000100:00100000:3.0:1787599286.398238:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599286.398248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3648:x1874433577864832:12345-0@lo:103: 00010000:00010000:3.0:1787599286.398272:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599286.398290:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf04b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf044 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.398314:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599286.398345:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:3648:x1874433577864832:12345-0@lo:103: Request processed in 99us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.398351:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599286.398378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577864832:0@lo:103: 00010000:00010000:3.0:1787599286.398395:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599286.398398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599286.398400:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787599286.398771:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599286.398779:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787599286.398785:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599286.398787:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787599286.398826:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599286.398841:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96b3706f4d28) 00000020:00000080:2.0:1787599286.398860:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787599286.398873:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599286.398935:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3778e6800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787599286.398943:0:8451:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599286.398949:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929cf067 00010000:00010000:2.0:1787599286.406370:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1787599286.407651:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787599286.412006:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787599286.412431:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787599286.417636:0:8451:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787599286.417841:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787599286.427329:0:8451:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787599286.429220:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787599286.429241:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599286.429250:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599286.429253:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787599286.429256:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599286.429262:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599286.429263:0:8451:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599286.429266:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599286.429269:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787599286.429306:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599286.429310:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599286.429312:0:8451:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787599286.429315:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787599286.429617:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787599286.429654:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787599286.429682:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.429696:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599286.429716:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3778e6800 from 1 10000000:01000000:3.0:1787599286.429719:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599286.429770:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.429781:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.429831:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.429876:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864960:0@lo:101: 00000100:00100000:3.0:1787599286.429987:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.430057:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.432234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577864960 00000100:00100000:0.0:1787599286.432253:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577864960 00000100:00100000:0.0:1787599286.432330:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787599286.432350:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577864960:12345-0@lo:101: 00010000:00010000:0.0:1787599286.432376:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599286.432401:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf06e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.432435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.432445:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.432455:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:0.0:1787599286.432552:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577864960:12345-0@lo:101: Request processed in 206us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.432561:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787599286.432688:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577864960:0@lo:101: 00010000:00010000:3.0:1787599286.432725:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.432738:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.433024:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865088:0@lo:501: 00000100:00100000:3.0:1787599286.433076:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.433123:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599286.433239:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865088 00000100:00100000:2.0:1787599286.433244:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865088 00000100:00100000:2.0:1787599286.433300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599286.433311:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865088:12345-0@lo:501: 00000100:00100000:2.0:1787599286.433455:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865088:12345-0@lo:501: Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.433463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787599286.433641:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865088:0@lo:501: 00000100:00100000:3.0:1787599286.433690:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865216:0@lo:503: 00000100:00100000:3.0:1787599286.433743:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.433772:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.434040:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865216 00000100:00100000:0.0:1787599286.434046:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865216 00000100:00100000:0.0:1787599286.434076:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787599286.434085:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865216:12345-0@lo:503: 00000100:00100000:0.0:1787599286.434204:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865216:12345-0@lo:503: Request processed in 120us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.434212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599286.436243:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865216:0@lo:503: 00000040:00080000:2.0:1787599286.436642:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599286.436757:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865344:0@lo:502: 00000100:00100000:2.0:1787599286.436957:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.437013:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599286.437100:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865344 00000100:00100000:3.0:1787599286.437109:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865344 00000100:00100000:3.0:1787599286.437172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787599286.437185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865344:12345-0@lo:502: 00000100:00100000:3.0:1787599286.437323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865344:12345-0@lo:502: Request processed in 139us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.437331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599286.437507:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865344:0@lo:502: 00000040:00080000:1.0:1787599286.437777:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787599286.437843:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787599286.439614:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865472:0@lo:502: 00000100:00100000:1.0:1787599286.439729:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.439785:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.444141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865472 00000100:00100000:0.0:1787599286.444155:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865472 00000100:00100000:0.0:1787599286.444210:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787599286.444220:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865472:12345-0@lo:502: 00000100:00100000:0.0:1787599286.444387:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865472:12345-0@lo:502: Request processed in 167us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.444403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787599286.444469:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865472:0@lo:502: 00000040:00080000:0.0:1787599286.444575:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787599286.444591:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787599286.445045:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599286.445056:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599286.445058:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599286.445063:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3778e6800 00000020:00000080:1.0:1787599286.445066:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599286.445077:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599286.445080:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599286.445081:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787599286.445083:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787599286.445190:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787599286.445213:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599286.445237:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.445248:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599286.445295:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599286.445298:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b3778e6800 10000000:01000000:0.0:1787599286.445301:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b3778e6800 10000000:01000000:0.0:1787599286.445304:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599286.445311:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3778e6800 from 1 10000000:01000000:0.0:1787599286.445314:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599286.445344:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.445352:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599286.445360:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599286.445378:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865600:0@lo:101: 00000100:00100000:0.0:1787599286.445425:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599286.445466:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345d16f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599286.445693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865600 00000100:00100000:2.0:1787599286.445701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865600 00000100:00100000:2.0:1787599286.445784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599286.445822:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8427:x1874433577865600:12345-0@lo:101: 00010000:00010000:2.0:1787599286.445834:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599286.445846:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf07c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.445876:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.445886:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.445894:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6800, rc 0) 00000100:00100000:2.0:1787599286.445937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865600:12345-0@lo:101: Request processed in 144us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.445944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599286.446039:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865600:0@lo:101: 00010000:00010000:1.0:1787599286.446058:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599286.446066:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599286.446137:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865728:0@lo:501: 00000100:00100000:1.0:1787599286.446164:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.448561:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.448775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865728 00000100:00100000:0.0:1787599286.448785:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865728 00000100:00100000:0.0:1787599286.449457:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787599286.449468:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865728:12345-0@lo:501: 00000100:00100000:0.0:1787599286.449770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865728:12345-0@lo:501: Request processed in 303us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.449779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599286.450302:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865728:0@lo:501: 00000100:00100000:1.0:1787599286.450350:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865856:0@lo:503: 00000100:00100000:1.0:1787599286.450402:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.452456:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.452749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865856 00000100:00100000:0.0:1787599286.452759:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865856 00000100:00100000:0.0:1787599286.452842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787599286.452853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865856:12345-0@lo:503: 00000100:00100000:0.0:1787599286.453012:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865856:12345-0@lo:503: Request processed in 160us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.453019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599286.453186:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865856:0@lo:503: 00000040:00080000:3.0:1787599286.453491:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599286.453562:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865984:0@lo:502: 00000100:00100000:3.0:1787599286.453610:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.453639:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.453769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577865984 00000100:00100000:0.0:1787599286.453774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577865984 00000100:00100000:0.0:1787599286.453829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787599286.453838:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865984:12345-0@lo:502: 00000100:00100000:0.0:1787599286.453934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577865984:12345-0@lo:502: Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.453941:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787599286.454213:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577865984:0@lo:502: 00000040:00080000:3.0:1787599286.454432:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787599286.454457:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787599286.454483:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787599286.454498:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787599286.454511:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787599286.454525:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787599286.454536:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787599286.454548:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787599286.454560:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787599286.454572:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787599286.454586:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787599286.454597:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787599286.454610:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787599286.454623:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787599286.454635:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787599286.454647:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787599286.454658:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787599286.454669:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787599286.454694:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787599286.454731:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787599286.454746:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787599286.454761:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787599286.454774:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787599286.454820:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787599286.454840:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787599286.454854:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787599286.455082:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787599286.455104:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787599286.455131:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787599286.455146:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787599286.455160:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787599286.455170:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787599286.455181:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787599286.455480:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787599286.455513:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787599286.455530:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787599286.455543:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787599286.455572:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577866112:0@lo:502: 00000100:00100000:3.0:1787599286.455623:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.455723:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599286.459206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866112 00000100:00100000:0.0:1787599286.459221:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866112 00000100:00100000:0.0:1787599286.459315:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787599286.459326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577866112:12345-0@lo:502: 00000100:00100000:0.0:1787599286.459501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577866112:12345-0@lo:502: Request processed in 176us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.459516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787599286.459604:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577866112:0@lo:502: 00000040:00080000:3.0:1787599286.459685:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787599286.459698:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787599286.461090:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787599286.461108:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96b3707bb370) 00000020:00000080:3.0:1787599286.461132:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787599286.461274:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3778e6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787599286.461279:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3778e6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787599286.461281:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3778e6800 3 00010000:00080000:3.0:1787599286.461311:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2419da000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599286.469249:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787599286.472577:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787599286.472635:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599286.472649:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d2988b0929cf091 00000100:00080000:0.0:1787599286.472661:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599286.472667:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b2419da000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599286.472718:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b345e00e00 x1874433577866240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599286.472754:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787599286.473061:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433577866240:0@lo:38: 00000100:00100000:1.0:1787599286.473130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.473910:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577866752:0@lo:400: 00000100:00100000:1.0:1787599286.473949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.473972:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599286.473978:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577866368:0@lo:400: 00000100:00100000:1.0:1787599286.474001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.474034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866752 00000100:00100000:1.0:1787599286.474042:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866752 00000100:00100000:1.0:1787599286.474083:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599286.474093:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577866752:12345-0@lo:400: 00000100:00100000:1.0:1787599286.474145:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577866752:12345-0@lo:400: Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.474163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599286.474256:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866240 00000100:00100000:1.0:1787599286.474262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866240 00000100:00100000:1.0:1787599286.474283:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866368 00000100:00100000:1.0:1787599286.474286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866368 00000100:00100000:1.0:1787599286.474318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599286.474324:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577866368:12345-0@lo:400: 00000100:00100000:1.0:1787599286.474357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577866368:12345-0@lo:400: Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.474363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599286.474377:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599286.474381:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433577866240:12345-0@lo:38: 00010000:00080000:1.0:1787599286.474401:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1787599286.474431:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d2988b0929cf098 00000004:00100000:1.0:1787599286.474445:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599286.474474:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96b37bb4f000 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1787599286.474701:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787599286.474730:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96b345e08000) 00000020:00000080:0.0:1787599286.474747:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787599286.474836:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3778e6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787599286.474840:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3778e6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787599286.474842:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3778e6800 3 00010000:00080000:0.0:1787599286.474868:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3819f1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.101@tcp at head 00000100:00100000:1.0:1787599286.475295:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874433577866240:12345-0@lo:38: Request processed in 910us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.475303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787599286.475349:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b345e00e00 x1874433577866240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599286.475360:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599286.475368:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787599286.475376:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787599286.475380:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599286.475382:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599286.475396:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433577866240:0@lo:38: 00010000:00080000:1.0:1787599286.475428:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2419bd880 x1874433577866368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599286.475438:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577866368:0@lo:400: 00000100:00100000:1.0:1787599286.475449:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577866752:0@lo:400: 00000100:00100000:3.0:1787599286.476110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577866496:0@lo:400: 00000100:00100000:3.0:1787599286.476159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.480376:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599286.480407:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577866624:0@lo:400: 00000100:00100000:3.0:1787599286.480489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.480869:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866496 00000100:00100000:2.0:1787599286.480880:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866496 00000100:00100000:2.0:1787599286.480942:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599286.480953:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577866496:12345-0@lo:400: 00000100:00100000:3.0:1787599286.481066:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866624 00000100:00100000:3.0:1787599286.481083:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866624 00000100:00100000:3.0:1787599286.481113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599286.481120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577866624:12345-0@lo:400: 00010000:00010000:0.0:1787599286.482602:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787599286.486390:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787599286.486438:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599286.486452:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5d2988b0929cf0a6 00000100:00080000:0.0:1787599286.486463:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599286.486470:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff96b3819f1800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599286.486669:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b345e03480 x1874433577866880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599286.486701:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787599286.487001:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433577866880:0@lo:38: 00000100:00100000:2.0:1787599286.487167:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577866496:12345-0@lo:400: Request processed in 6213us (11004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.487178:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000040:00080000:2.0:1787599286.488014:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787599286.488501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577866496:0@lo:400: 00000100:00100000:3.0:1787599286.493946:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577866624:12345-0@lo:400: Request processed in 12814us (13444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.493964:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:3.0:1787599286.494036:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787599286.494081:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599286.494109:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.494121:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599286.494184:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599286.494187:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599286.494188:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599286.494198:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599286.494199:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599286.494201:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599286.494203:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599286.494204:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599286.494205:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599286.494207:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599286.494208:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599286.494213:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787599286.494215:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599286.494217:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599286.494218:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599286.494219:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599286.494220:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599286.494221:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599286.494222:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599286.494222:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599286.494223:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599286.494231:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599286.494232:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599286.494262:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787599286.494281:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577867008:0@lo:253: 00000100:00100000:3.0:1787599286.494338:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.494374:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599286.494393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867008 00000100:00100000:3.0:1787599286.494400:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867008 00000100:00100000:3.0:1787599286.494441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787599286.494449:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:8427:x1874433577867008:12345-0@lo:253: 20000000:01000000:3.0:1787599286.494477:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787599286.494491:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787599286.495654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599286.495691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577866880 00000100:00100000:1.0:1787599286.495697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577866880 00000100:00100000:1.0:1787599286.495742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599286.495750:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874433577866880:12345-0@lo:38: 00010000:00080000:1.0:1787599286.495774:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1787599286.495834:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5d2988b0929cf0ad 00000004:00100000:1.0:1787599286.495847:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599286.495877:0:6521:0:(import.c:65:import_set_state_nolock()) ffff96b37bb48800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599286.495924:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874433577866880:12345-0@lo:38: Request processed in 174us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.495932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787599286.495977:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b345e03480 x1874433577866880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599286.495987:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599286.495995:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787599286.496002:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787599286.496006:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787599286.496008:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3819f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599286.496021:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433577866880:0@lo:38: 00010000:00080000:0.0:1787599286.506483:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2419bea00 x1874433577866624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599286.506538:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577866624:0@lo:400: 00010000:00010000:2.0:1787599286.506718:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787599286.513689:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787599286.513718:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787599286.514038:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787599286.514043:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787599286.514068:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514087:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514094:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514101:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514143:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514157:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.514203:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577867136:0@lo:104: 00000100:00100000:3.0:1787599286.514277:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599286.514337:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.514345:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 16 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.514353:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577867264:0@lo:104: 00000100:00100000:3.0:1787599286.514374:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b38128a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599286.514430:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787599286.514449:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.514477:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867136 00000100:00100000:2.0:1787599286.514485:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867136 00000100:00100000:2.0:1787599286.514540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867264 00000100:00100000:2.0:1787599286.514543:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867264 00000100:00100000:2.0:1787599286.514559:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599286.514568:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b381b26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577867136:12345-0@lo:104: 00010000:00010000:2.0:1787599286.514580:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514627:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599286.514632:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b381b26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577867136:12345-0@lo:104: Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.514639:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599286.514676:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599286.514683:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577867264:12345-0@lo:104: 00010000:00010000:2.0:1787599286.514690:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514744:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599286.514750:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577867264:12345-0@lo:104: Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.514756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787599286.514777:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599286.514783:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514812:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599286.514817:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514824:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599286.514831:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599286.514836:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599286.514882:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514888:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599286.514904:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514910:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152ac00/0x5d2988b0929cefbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefc6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514934:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599286.514936:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514942:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599286.514945:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514951:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599286.514957:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599286.514961:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599286.514974:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514980:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599286.514993:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.514999:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340031e00/0x5d2988b0929cefa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cefaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599286.515014:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599286.515016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599286.515018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599286.515025:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599286.515043:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577867520:0@lo:103: 00000100:00100000:2.0:1787599286.515073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.515309:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577867136:0@lo:104: 00000100:00100000:3.0:1787599286.515319:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577867264:0@lo:104: 00010000:00010000:3.0:1787599286.515337:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599286.515363:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577867392:0@lo:103: 00000100:00100000:3.0:1787599286.515389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599286.515436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867520 00000100:00100000:3.0:1787599286.515441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867520 00010000:00010000:3.0:1787599286.515461:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 17 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.515481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867392 00000100:00100000:3.0:1787599286.515484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867392 00010000:00010000:3.0:1787599286.515493:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 18 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.515535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599286.515543:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3646:x1874433577867520:12345-0@lo:103: 00010000:00010000:3.0:1787599286.515554:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599286.515559:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 18 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515568:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 18 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515582:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497200/0x5d2988b0929cefaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cefa3 expref: 18 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515593:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599286.515624:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3646:x1874433577867520:12345-0@lo:103: Request processed in 82us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.515630:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599286.515643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599286.515649:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3648:x1874433577867392:12345-0@lo:103: 00010000:00010000:3.0:1787599286.515671:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599286.515677:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515685:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515695:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031000/0x5d2988b0929cefc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cefbf expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515730:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515737:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599286.515750:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006699858s 00010000:00010000:3.0:1787599286.515755:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515762:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515768:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515774:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515780:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d1200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599286.515785:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515813:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515827:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.515836:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599286.515976:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3648:x1874433577867392:12345-0@lo:103: Request processed in 325us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.515982:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787599286.516004:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.516012:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599286.516018:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599286.516046:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577867392:0@lo:103: 00000100:00100000:3.0:1787599286.516069:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577867520:0@lo:103: 00000100:00100000:3.0:1787599286.517262:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:8427:x1874433577867008:12345-0@lo:253: Request processed in 22809us (22918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599286.517274:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599286.517364:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8427:1874433577867008:0@lo:253: 10000000:01000000:2.0:1787599286.517379:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787599286.517382:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599286.517384:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599286.517385:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599286.517387:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599286.517393:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599286.517395:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599286.517396:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599286.517398:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599286.517399:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599286.517401:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599286.517402:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787599286.517418:0:8427:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787599286.525058:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787599286.526137:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787599286.526966:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787599286.527168:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787599286.527645:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787599286.530743:0:8427:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787599286.536479:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787599286.553426:0:8427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787599286.553437:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787599286.553474:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599286.553540:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599286.553563:0:8427:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787599286.553591:0:8427:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787599286.558605:0:8427:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599286.558817:0:8427:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1787599286.821132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599286.821157:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577867648:0@lo:41: 00000100:00100000:2.0:1787599286.821269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.821336:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867648 00000100:00100000:2.0:1787599286.821344:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867648 00000100:00100000:2.0:1787599286.821393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599286.821402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577867648:12345-0@lo:41: 00000004:00000024:2.0:1787599286.821440:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1787599286.821485:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577867648:12345-0@lo:41: Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599286.821493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599286.821554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577867648:0@lo:41: 00010000:00010000:2.0:1787599287.529218:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787599287.747427:0:8512:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599287.748072:0:8512:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787599288.357093:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577867776:0@lo:41: 00000100:00100000:0.0:1787599288.357175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599288.357283:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867776 00000100:00100000:1.0:1787599288.357291:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867776 00000100:00100000:1.0:1787599288.357342:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599288.357352:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577867776:12345-0@lo:41: 00000004:00000024:1.0:1787599288.357386:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787599288.366410:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577867776:12345-0@lo:41: Request processed in 9049us (9238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599288.366424:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599288.366566:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577867776:0@lo:41: 00010000:00010000:1.0:1787599288.549194:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599289.573961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787599290.149149:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787599290.149157:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3812cf000 from 30 10000000:01000000:3.0:1787599290.149162:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787599290.149204:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.149225:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.149237:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599290.149260:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577867904:0@lo:101: 00000100:00100000:3.0:1787599290.149332:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.149381:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.149437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577867904 00000100:00100000:0.0:1787599290.149445:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577867904 00000100:00100000:0.0:1787599290.149502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599290.149512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:6517:x1874433577867904:12345-0@lo:101: 00010000:00010000:0.0:1787599290.149523:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599290.149535:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf0bb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.149557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.149567:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.149576:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031400, rc 0) 00000100:00100000:0.0:1787599290.149619:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577867904:12345-0@lo:101: Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.149625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599290.149750:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577867904:0@lo:101: 00010000:00010000:3.0:1787599290.149763:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.149771:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599290.149856:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868032:0@lo:501: 00000100:00100000:3.0:1787599290.149881:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.149898:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.150186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868032 00000100:00100000:2.0:1787599290.150191:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868032 00000100:00100000:2.0:1787599290.150228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787599290.150235:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577868032:12345-0@lo:501: 00000100:00100000:2.0:1787599290.150349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577868032:12345-0@lo:501: Request processed in 114us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.150356:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787599290.150386:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868032:0@lo:501: 00000100:00100000:2.0:1787599290.150413:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868160:0@lo:503: 00000100:00100000:2.0:1787599290.150449:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.150479:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.150490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868160 00000100:00100000:2.0:1787599290.150494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868160 00000100:00100000:2.0:1787599290.150521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787599290.150528:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577868160:12345-0@lo:503: 00000100:00100000:2.0:1787599290.150602:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577868160:12345-0@lo:503: Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.150609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787599290.150646:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868160:0@lo:503: 00000100:00100000:3.0:1787599290.158653:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8618:1874433577868288:0@lo:502: 00000100:00100000:3.0:1787599290.158752:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.158816:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.159065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868288 00000100:00100000:2.0:1787599290.159073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868288 00000100:00100000:2.0:1787599290.159120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787599290.159130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8618:x1874433577868288:12345-0@lo:502: 00000100:00100000:2.0:1787599290.159380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8618:x1874433577868288:12345-0@lo:502: Request processed in 250us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.159388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787599290.166631:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8618:1874433577868288:0@lo:502: 00000100:00100000:1.0:1787599290.166725:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8618:1874433577868416:0@lo:502: 00000100:00100000:1.0:1787599290.167342:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.167381:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.167441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868416 00000100:00100000:3.0:1787599290.167450:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868416 00000100:00100000:3.0:1787599290.167635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599290.167644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8618:x1874433577868416:12345-0@lo:502: 00000100:00100000:3.0:1787599290.169197:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:8618:x1874433577868416:12345-0@lo:502: Request processed in 1551us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.169209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787599290.180582:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8618:1874433577868416:0@lo:502: 00000040:00080000:3.0:1787599290.180694:0:8618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787599290.180878:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787599290.180907:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599290.180917:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.180929:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599290.180939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599290.180942:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3812cf000 from 5 10000000:01000000:2.0:1787599290.180944:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599290.180985:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.181007:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.181018:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599290.181037:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868544:0@lo:101: 00000100:00100000:2.0:1787599290.181099:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.181178:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.189969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868544 00000100:00100000:3.0:1787599290.189986:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868544 00000100:00100000:3.0:1787599290.190051:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787599290.190062:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577868544:12345-0@lo:101: 00010000:00010000:3.0:1787599290.190089:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599290.190108:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf0c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.190135:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.190147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599290.190156:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3821d1200, rc 0) 00000100:00100000:3.0:1787599290.190326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577868544:12345-0@lo:101: Request processed in 264us (9225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.190333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787599290.196613:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868544:0@lo:101: 00010000:00010000:2.0:1787599290.196640:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.196652:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599290.196733:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868672:0@lo:256: 00000100:00100000:2.0:1787599290.196998:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.197092:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.207636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868672 00000100:00100000:3.0:1787599290.207651:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868672 00000100:00100000:3.0:1787599290.207719:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787599290.207730:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577868672:12345-0@lo:256: 20000000:01000000:3.0:1787599290.207769:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599290.207788:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599290.207809:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787599290.207935:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577868672:12345-0@lo:256: Request processed in 206us (10936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.207943:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787599290.209448:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868672:0@lo:256: 10000000:01000000:2.0:1787599290.209531:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599290.209543:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.209554:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599290.209574:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787599290.209577:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787599290.209579:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599290.209610:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.209617:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.209626:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599290.209644:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868800:0@lo:101: 00000100:00100000:2.0:1787599290.209695:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.209890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868800 00000100:00100000:0.0:1787599290.209898:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868800 00000100:00100000:0.0:1787599290.209940:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787599290.209955:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577868800:12345-0@lo:101: 00010000:00010000:0.0:1787599290.209966:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599290.209989:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf0d7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.210010:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.210021:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.210030:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031e00, rc 0) 00000100:00100000:0.0:1787599290.210063:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577868800:12345-0@lo:101: Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.210069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599290.210311:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.210327:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868800:0@lo:101: 00010000:00010000:2.0:1787599290.210339:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.210348:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599290.210399:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868928:0@lo:501: 00000100:00100000:2.0:1787599290.210424:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.210452:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.212311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577868928 00000100:00100000:0.0:1787599290.212325:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577868928 00000100:00100000:0.0:1787599290.212374:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787599290.212385:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577868928:12345-0@lo:501: 00000100:00100000:0.0:1787599290.212548:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577868928:12345-0@lo:501: Request processed in 164us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.212556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787599290.212988:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577868928:0@lo:501: 00000100:00100000:2.0:1787599290.213027:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577869056:0@lo:503: 00000100:00100000:2.0:1787599290.213085:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.213114:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.213131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869056 00000100:00100000:2.0:1787599290.213134:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869056 00000100:00100000:2.0:1787599290.213155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787599290.213161:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577869056:12345-0@lo:503: 00000100:00100000:2.0:1787599290.213263:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577869056:12345-0@lo:503: Request processed in 101us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.213270:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787599290.213307:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577869056:0@lo:503: 00000100:00100000:2.0:1787599290.229575:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8621:1874433577869184:0@lo:502: 00000100:00100000:2.0:1787599290.229663:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.229733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869184 00000100:00100000:2.0:1787599290.230131:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869184 00000100:00100000:2.0:1787599290.230182:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787599290.230308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8621:x1874433577869184:12345-0@lo:502: 00000100:00100000:2.0:1787599290.230433:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8621:x1874433577869184:12345-0@lo:502: Request processed in 242us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.230441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787599290.232113:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.232142:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8621:1874433577869184:0@lo:502: 00000020:01000000:2.0:1787599290.232176:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599290.232185:0:8621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787599290.232201:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.232203:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787599290.232207:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599290.235074:0:8621:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1787599290.235119:0:8621:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787599290.235124:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599290.235141:0:8621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff96b3706f19b8) 00000020:00000080:2.0:1787599290.235164:0:8621:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787599290.235171:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599290.236334:0:8621:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787599290.236342:0:8621:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599290.236359:0:8621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929cf0ec 00010000:00080000:2.0:1787599290.236395:0:8621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b377b88800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599290.238888:0:8621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787599290.257539:0:8621:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787599290.257558:0:8621:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787599290.258076:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599290.259652:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599290.259775:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787599290.261550:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787599290.269058:0:8623:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599290.269067:0:8623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787599290.299739:0:8621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599290.299762:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599290.299825:0:8621:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599290.299858:0:8621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cf0f3 00000100:00080000:2.0:1787599290.299870:0:8621:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599290.299875:0:8621:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b377b88800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599290.299909:0:8621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b370010a80 x1874433577869312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599290.299939:0:8621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599290.300294:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599290.300300:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.300302:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599290.300305:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599290.300309:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.300310:0:8621:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599290.300313:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599290.300314:0:8621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787599290.300352:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8621:1874433577869440:0@lo:502: 00000100:00100000:2.0:1787599290.300421:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.300534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869440 00000100:00100000:2.0:1787599290.300541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869440 00000100:00100000:2.0:1787599290.300577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787599290.300587:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8621:x1874433577869440:12345-0@lo:502: 00000100:00100000:2.0:1787599290.300701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:8621:x1874433577869440:12345-0@lo:502: Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.300708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599290.309347:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577869312:0@lo:8: 00000100:00100000:0.0:1787599290.309426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.309598:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577869952:0@lo:400: 00000100:00100000:0.0:1787599290.309623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.309641:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599290.309646:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577869568:0@lo:400: 00000100:00100000:1.0:1787599290.312035:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869312 00000100:00100000:1.0:1787599290.312050:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869312 00000100:00100000:1.0:1787599290.312091:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599290.312099:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433577869312:12345-0@lo:8: 00010000:00080000:1.0:1787599290.312130:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:1.0:1787599290.312160:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cf0fa 00002000:00100000:1.0:1787599290.312202:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff96b37bb4d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787599290.312207:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000100:00100000:0.0:1787599290.312339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.312376:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577870080:0@lo:400: 00000100:00100000:0.0:1787599290.312430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.312480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577869696:0@lo:400: 00000100:00100000:0.0:1787599290.312509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.312529:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577870208:0@lo:400: 00000100:00100000:0.0:1787599290.312555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.312576:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599290.312582:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577869824:0@lo:400: 00000100:00100000:0.0:1787599290.312615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.312639:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869952 00000100:00100000:0.0:1787599290.312644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869952 00000100:00100000:0.0:1787599290.312685:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869696 00000100:00100000:0.0:1787599290.312688:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869696 00000100:00100000:0.0:1787599290.312700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599290.312706:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577869952:12345-0@lo:400: 00000100:00100000:0.0:1787599290.312764:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577869952:12345-0@lo:400: Request processed in 57us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.312771:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599290.312785:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599290.312814:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577869696:12345-0@lo:400: 00000100:00100000:0.0:1787599290.312846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577869696:12345-0@lo:400: Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.312852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599290.312868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869568 00000100:00100000:0.0:1787599290.312872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869568 00000100:00100000:0.0:1787599290.312888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870080 00000100:00100000:0.0:1787599290.312897:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870080 00000100:00100000:0.0:1787599290.312922:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870208 00000100:00100000:0.0:1787599290.312925:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870208 00000100:00100000:0.0:1787599290.312936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577869824 00000100:00100000:0.0:1787599290.312938:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577869824 00000100:00100000:0.0:1787599290.312950:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599290.312956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577869568:12345-0@lo:400: 00000100:00100000:0.0:1787599290.312988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577869568:12345-0@lo:400: Request processed in 32us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.312994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599290.313006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599290.313012:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577870080:12345-0@lo:400: 00000100:00100000:0.0:1787599290.313039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577870080:12345-0@lo:400: Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.313044:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599290.313054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599290.313059:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577870208:12345-0@lo:400: 00000100:00100000:0.0:1787599290.313082:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577870208:12345-0@lo:400: Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.313086:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599290.313096:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599290.313101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577869824:12345-0@lo:400: 00000100:00100000:0.0:1787599290.313123:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577869824:12345-0@lo:400: Request processed in 22us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.313128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787599290.313166:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e00a80 x1874433577869568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.313192:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577869568:0@lo:400: 00010000:00080000:0.0:1787599290.313204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e00e00 x1874433577870080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.313324:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577870080:0@lo:400: 00000100:00100000:0.0:1787599290.313339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577869952:0@lo:400: 00010000:00080000:0.0:1787599290.313387:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e02d80 x1874433577869824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.313395:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577869824:0@lo:400: 00000100:00100000:0.0:1787599290.313404:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577869696:0@lo:400: 00010000:00080000:0.0:1787599290.313413:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e01f80 x1874433577870208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.313421:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577870208:0@lo:400: 00000100:00080000:0.0:1787599290.313443:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599290.313448:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:1.0:1787599290.315856:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787599290.315940:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599290.316178:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787599290.316221:0:8433:0:(import.c:65:import_set_state_nolock()) ffff96b37bb4b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599290.316305:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433577869312:12345-0@lo:8: Request processed in 4204us (6877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.316313:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787599290.316383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370010a80 x1874433577869312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599290.316392:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599290.316401:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787599290.316409:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599290.316414:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787599290.316416:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b377b88800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599290.316425:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599290.316430:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577869312:0@lo:8: 00000004:00080000:1.0:1787599290.316454:0:8623:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599290.316503:0:8623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 236935709820ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787599290.316509:0:8623:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787599290.322202:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577870336:0@lo:700: 00000100:00100000:3.0:1787599290.322367:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.322401:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8621:1874433577869440:0@lo:502: 00000020:01000000:3.0:1787599290.322437:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599290.322445:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599290.322447:0:8621:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787599290.322462:0:8621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787599290.322764:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787599290.322783:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787599290.322822:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.322841:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599290.322852:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787599290.322854:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3707b1000 from 30 10000000:01000000:2.0:1787599290.322857:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599290.322882:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.322890:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.322900:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599290.322911:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870464:0@lo:101: 00000100:00100000:2.0:1787599290.322979:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.323005:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b346771300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.323051:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.323069:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b346771600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.323752:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870464 00000100:00100000:1.0:1787599290.323760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870464 00000100:00100000:1.0:1787599290.323826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599290.323844:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577870464:12345-0@lo:101: 00010000:00010000:1.0:1787599290.323857:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599290.323869:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf101 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.323892:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.323902:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.323919:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341497e00, rc 0) 00000100:00100000:1.0:1787599290.323961:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577870464:12345-0@lo:101: Request processed in 127us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.323968:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599290.324015:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870336 00000100:00100000:1.0:1787599290.324020:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870336 00000100:00100000:1.0:1787599290.324054:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599290.324060:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8624:x1874433577870336:12345-0@lo:700: 00000100:00100000:1.0:1787599290.324091:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874433577870592:0@lo:700: 00000100:00100000:1.0:1787599290.324119:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.324136:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.324162:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870464:0@lo:101: 00010000:00010000:1.0:1787599290.324176:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.324185:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599290.324415:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870720:0@lo:501: 00000100:00100000:1.0:1787599290.324442:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.324984:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787599290.324997:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599290.325009:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870592 00000100:00100000:1.0:1787599290.325013:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870592 00000100:00100000:1.0:1787599290.325047:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599290.325054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874433577870592:12345-0@lo:700: 00000100:00100000:1.0:1787599290.325158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870720 00000100:00100000:1.0:1787599290.325163:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870720 00000100:00100000:1.0:1787599290.325187:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599290.325193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577870720:12345-0@lo:501: 00000100:00100000:1.0:1787599290.330582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577870720:12345-0@lo:501: Request processed in 5379us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.330595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599290.331170:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870720:0@lo:501: 00000100:00100000:1.0:1787599290.332044:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870848:0@lo:503: 00000100:00100000:1.0:1787599290.332109:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.332141:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.332839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870848 00000100:00100000:2.0:1787599290.332848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870848 00000100:00100000:2.0:1787599290.332896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787599290.332905:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577870848:12345-0@lo:503: 00000100:00100000:2.0:1787599290.333012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577870848:12345-0@lo:503: Request processed in 107us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.333020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599290.333365:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577870848:0@lo:503: 00000004:00080000:0.0:1787599290.335986:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787599290.337295:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8625:1874433577870976:0@lo:502: 00000100:00100000:3.0:1787599290.337372:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.337414:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.337512:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577870976 00000100:00100000:1.0:1787599290.337520:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577870976 00000100:00100000:1.0:1787599290.337570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599290.337579:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8625:x1874433577870976:12345-0@lo:502: 00000100:00100000:1.0:1787599290.337721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8625:x1874433577870976:12345-0@lo:502: Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.337729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599290.337815:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8625:1874433577870976:0@lo:502: 00000100:00100000:1.0:1787599290.337869:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8625:1874433577871104:0@lo:502: 00000100:00100000:1.0:1787599290.337905:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.337927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871104 00000100:00100000:1.0:1787599290.337931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871104 00000100:00100000:1.0:1787599290.337952:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787599290.337965:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8625:x1874433577871104:12345-0@lo:502: 00000100:00100000:1.0:1787599290.338022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:8625:x1874433577871104:12345-0@lo:502: Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.338029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787599290.338057:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.338070:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8625:1874433577871104:0@lo:502: 00000040:00080000:1.0:1787599290.338090:0:8625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787599290.338143:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787599290.338162:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787599290.338171:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.338182:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599290.338192:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599290.338195:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3707b1000 from 5 10000000:01000000:1.0:1787599290.338198:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 40000000:02000000:2.0:1787599290.338934:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787599290.342231:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874433577870592:12345-0@lo:700: Request processed in 17170us (18103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.342249:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787599290.343456:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.343469:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599290.343481:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599290.343502:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871232:0@lo:101: 00000100:00100000:1.0:1787599290.343549:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.343598:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789840 going to sleep for 11 seconds 00010000:00080000:1.0:1787599290.343637:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419bdc00 x1874433577870592/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599290.343651:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874433577870592:0@lo:700: 40000000:02000000:1.0:1787599290.343661:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1787599290.344419:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871232 00000100:00100000:0.0:1787599290.344426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871232 00000100:00100000:0.0:1787599290.344470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599290.344480:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577871232:12345-0@lo:101: 00010000:00010000:0.0:1787599290.344494:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599290.344509:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf10f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.344532:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.344550:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.344559:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031000, rc 0) 00000100:00100000:0.0:1787599290.344598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577871232:12345-0@lo:101: Request processed in 120us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.344605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599290.344658:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871232:0@lo:101: 00010000:00010000:0.0:1787599290.344682:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.344690:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599290.344755:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871360:0@lo:256: 00000100:00100000:0.0:1787599290.344787:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.344828:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.344849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871360 00000100:00100000:0.0:1787599290.344854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871360 00000100:00100000:0.0:1787599290.344877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787599290.344883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577871360:12345-0@lo:256: 20000000:01000000:0.0:1787599290.344897:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599290.344913:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599290.344916:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787599290.344992:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577871360:12345-0@lo:256: Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.344999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787599290.345036:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871360:0@lo:256: 10000000:01000000:0.0:1787599290.345076:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599290.345082:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345090:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599290.345097:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787599290.345100:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787599290.345103:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599290.345119:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345126:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345133:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599290.345144:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871488:0@lo:101: 00000100:00100000:0.0:1787599290.345168:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.345182:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.345193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871488 00000100:00100000:0.0:1787599290.345196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871488 00000100:00100000:0.0:1787599290.345352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787599290.345360:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577871488:12345-0@lo:101: 00010000:00010000:0.0:1787599290.345367:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599290.345376:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf11d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345396:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345405:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345413:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030800, rc 0) 00000100:00100000:0.0:1787599290.345442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577871488:12345-0@lo:101: Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.345447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787599290.345476:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871488:0@lo:101: 00010000:00010000:0.0:1787599290.345486:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.345493:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599290.345542:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871616:0@lo:501: 00000100:00100000:0.0:1787599290.345566:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.345579:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.345589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871616 00000100:00100000:0.0:1787599290.345592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871616 00000100:00100000:0.0:1787599290.345613:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787599290.345618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577871616:12345-0@lo:501: 00000100:00100000:0.0:1787599290.345730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577871616:12345-0@lo:501: Request processed in 111us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.346301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787599290.346352:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871616:0@lo:501: 00000100:00100000:0.0:1787599290.346378:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871744:0@lo:503: 00000100:00100000:0.0:1787599290.346419:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.346441:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.346464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871744 00000100:00100000:0.0:1787599290.346468:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871744 00000100:00100000:0.0:1787599290.346490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787599290.346497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577871744:12345-0@lo:503: 00000100:00100000:0.0:1787599290.346573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577871744:12345-0@lo:503: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.346579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787599290.346613:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577871744:0@lo:503: 00000001:00100000:0.0:1787599290.356265:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787599290.357596:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8626:1874433577871872:0@lo:502: 00000100:00100000:0.0:1787599290.357662:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.357713:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.357770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577871872 00000100:00100000:2.0:1787599290.357777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577871872 00000100:00100000:0.0:1787599290.357988:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787599290.357999:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:8626:x1874433577871872:12345-0@lo:502: 00000100:00100000:0.0:1787599290.358127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:8626:x1874433577871872:12345-0@lo:502: Request processed in 130us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.358135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599290.358227:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8626:1874433577871872:0@lo:502: 00000020:01000000:3.0:1787599290.358255:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599290.358261:0:8626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787599290.358268:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599290.358270:0:8626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787599290.358275:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787599290.358278:0:8626:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1787599290.358301:0:8626:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787599290.358304:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599290.358327:0:8626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96b37f898000) 00000020:00000080:3.0:1787599290.358348:0:8626:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787599290.358355:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787599290.358436:0:8626:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787599290.358442:0:8626:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787599290.358448:0:8626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cf132 00010000:00080000:3.0:1787599290.358651:0:8626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b37f8b4800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599290.359040:0:8626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1787599290.360927:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577870336:12345-0@lo:700: Request processed in 36860us (37869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.360939:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787599290.361267:0:8624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ed80 x1874433577870336/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599290.361282:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577870336:0@lo:700: 00000004:00080000:2.0:1787599290.372437:0:8624:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787599290.372481:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577872128:0@lo:7: 00000100:00100000:2.0:1787599290.372550:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.372592:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345d16000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.372765:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577872000:0@lo:13: 00000100:00100000:0.0:1787599290.372824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.373110:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872128 00000100:00100000:3.0:1787599290.373118:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872128 00000100:00100000:3.0:1787599290.373168:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599290.373178:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577872128:12345-0@lo:7: 00000100:00100000:2.0:1787599290.384379:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872000 00000100:00100000:2.0:1787599290.384395:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872000 00000100:00100000:2.0:1787599290.384462:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599290.384473:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433577872000:12345-0@lo:13: 00002000:00000024:2.0:1787599290.384502:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:2.0:1787599290.384588:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433577872000:12345-0@lo:13: Request processed in 116us (11762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.384608:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787599290.385009:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ca80 x1874433577872000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.385047:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577872000:0@lo:13: 00000040:01000000:0.0:1787599290.388926:0:8626:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787599290.388945:0:8626:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787599290.389086:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599290.389251:0:8626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599290.389329:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787599290.389414:0:8626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787599290.390645:0:8627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599290.390650:0:8627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787599290.391402:0:8626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599290.391414:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599290.391469:0:8626:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599290.391494:0:8626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cf139 00000100:00080000:2.0:1787599290.391504:0:8626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599290.391510:0:8626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b37f8b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599290.391542:0:8626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138f100 x1874433577872256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599290.391569:0:8626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599290.391623:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599290.391627:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.391629:0:8626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599290.391632:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599290.391636:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.391637:0:8626:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599290.391640:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599290.391642:0:8626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787599290.391666:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8626:1874433577872384:0@lo:502: 00000100:00100000:2.0:1787599290.391763:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.391823:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345d16600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.392082:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577872512:0@lo:400: 00000100:00100000:0.0:1787599290.392112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392133:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577873024:0@lo:400: 00000100:00100000:0.0:1787599290.392153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392171:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599290.392177:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577872640:0@lo:400: 00000100:00100000:0.0:1787599290.392200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392229:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577873152:0@lo:400: 00000100:00100000:0.0:1787599290.392250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577872896:0@lo:400: 00000100:00100000:0.0:1787599290.392297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392316:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599290.392321:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577872768:0@lo:400: 00000100:00100000:0.0:1787599290.392342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392353:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577873280:0@lo:400: 00000100:00100000:0.0:1787599290.392373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.392409:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872512 00000100:00100000:0.0:1787599290.392415:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872512 00000100:00100000:0.0:1787599290.392444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873024 00000100:00100000:0.0:1787599290.392447:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873024 00000100:00100000:0.0:1787599290.392458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873152 00000100:00100000:0.0:1787599290.392461:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873152 00000100:00100000:0.0:1787599290.392470:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872768 00000100:00100000:0.0:1787599290.392473:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872768 00000100:00100000:0.0:1787599290.392487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599290.392495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577872512:12345-0@lo:400: 00000100:00100000:0.0:1787599290.392541:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577872512:12345-0@lo:400: Request processed in 46us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.392548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599290.392563:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599290.392570:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577873024:12345-0@lo:400: 00000100:00100000:0.0:1787599290.392595:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577873024:12345-0@lo:400: Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.392601:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599290.392612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599290.392618:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577873152:12345-0@lo:400: 00000100:00100000:0.0:1787599290.392643:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577873152:12345-0@lo:400: Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.392648:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599290.392658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599290.392664:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577872768:12345-0@lo:400: 00000100:00100000:0.0:1787599290.392705:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577872768:12345-0@lo:400: Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.392711:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599290.392752:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872640 00000100:00100000:0.0:1787599290.392756:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872640 00000100:00100000:0.0:1787599290.392777:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872896 00000100:00100000:0.0:1787599290.392780:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872896 00000100:00100000:0.0:1787599290.392812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599290.392820:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577872640:12345-0@lo:400: 00000100:00100000:0.0:1787599290.392995:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577872640:12345-0@lo:400: Request processed in 175us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.393002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599290.393015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599290.393022:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577872896:12345-0@lo:400: 00000100:00100000:0.0:1787599290.393048:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577872896:12345-0@lo:400: Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.393054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599290.393088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577872640:0@lo:400: 00010000:00080000:0.0:1787599290.393098:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afc000 x1874433577873152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.393106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577873152:0@lo:400: 00010000:00080000:0.0:1787599290.393114:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afd880 x1874433577872512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.393122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577872512:0@lo:400: 00010000:00080000:0.0:1787599290.393130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afd500 x1874433577873024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.393137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577873024:0@lo:400: 00010000:00080000:0.0:1787599290.393165:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afea00 x1874433577872768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.393181:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577872768:0@lo:400: 00000100:00100000:0.0:1787599290.393193:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577872896:0@lo:400: 00000100:00100000:1.0:1787599290.393506:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577872256:0@lo:8: 00000100:00100000:1.0:1787599290.393543:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599290.393583:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787599290.393591:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787599290.393782:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872384 00000100:00100000:2.0:1787599290.393787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872384 00000100:00100000:2.0:1787599290.393946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787599290.393955:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:8626:x1874433577872384:12345-0@lo:502: 00000100:00100000:2.0:1787599290.394063:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:8626:x1874433577872384:12345-0@lo:502: Request processed in 109us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.394070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787599290.394118:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:8626:1874433577872384:0@lo:502: 00000020:01000000:2.0:1787599290.394142:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599290.394148:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599290.394150:0:8626:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787599290.394154:0:8626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787599290.394586:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787599290.394610:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787599290.394618:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.394629:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599290.394638:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787599290.394641:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b34dcf99b8 from 1 10000000:01000000:0.0:1787599290.394643:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787599290.394667:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.394688:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.394696:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599290.394708:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577873408:0@lo:101: 00000100:00100000:0.0:1787599290.394734:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.394767:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.394784:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787599290.394856:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577872256 00000100:00100000:1.0:1787599290.394861:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577872256 00000100:00100000:1.0:1787599290.394927:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599290.394933:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1874433577872256:12345-0@lo:8: 00010000:00080000:1.0:1787599290.394956:0:8629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1787599290.394983:0:8629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cf147 00002000:00100000:1.0:1787599290.394996:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96b377b3e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787599290.395000:0:8629:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787599290.395002:0:8629:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599290.395055:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599290.395077:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b377b3f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599290.395126:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433577872256:12345-0@lo:8: Request processed in 191us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.395133:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599290.395161:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138f100 x1874433577872256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599290.395170:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599290.395177:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787599290.395185:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599290.395190:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787599290.395192:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599290.395202:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599290.395207:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577872256:0@lo:8: 00000100:00100000:0.0:1787599290.395407:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873280 00000100:00100000:0.0:1787599290.395412:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873280 00000100:00100000:0.0:1787599290.395447:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599290.395498:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433577873280:12345-0@lo:400: 00000100:00100000:0.0:1787599290.395535:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433577873280:12345-0@lo:400: Request processed in 82us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.395540:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787599290.395565:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afc700 x1874433577873280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599290.395574:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577873280:0@lo:400: 00000004:00080000:0.0:1787599290.395629:0:8627:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787599290.395664:0:8627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237014870654ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787599290.395682:0:8627:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787599290.396933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873408 00000100:00100000:2.0:1787599290.396942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873408 00000100:00100000:2.0:1787599290.396976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787599290.396985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577873408:12345-0@lo:101: 00010000:00010000:2.0:1787599290.396995:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599290.397009:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf140 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.397032:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.397044:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599290.397053:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6200, rc 0) 00000100:00100000:2.0:1787599290.397094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577873408:12345-0@lo:101: Request processed in 111us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599290.397099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787599290.398562:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577873408:0@lo:101: 00010000:00010000:0.0:1787599290.398581:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.398591:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599290.398655:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577873536:0@lo:501: 00000100:00100000:0.0:1787599290.398706:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599290.398746:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.399574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873536 00000100:00100000:1.0:1787599290.399582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873536 00000100:00100000:1.0:1787599290.399624:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787599290.399634:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577873536:12345-0@lo:501: 00000100:00100000:1.0:1787599290.399722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577873536:12345-0@lo:501: Request processed in 89us (1015us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599290.399729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787599290.400599:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577873536:0@lo:501: 10000000:01000000:0.0:1787599290.400635:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787599290.400643:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599290.400652:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787599290.407933:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787599290.407942:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787599290.408039:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577872128:12345-0@lo:7: Request processed in 34858us (35484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.408051:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599290.410113:0:8624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138fb80 x1874433577872128/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599290.410133:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577872128:0@lo:7: 00000004:00080000:2.0:1787599290.410149:0:8624:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787599290.410196:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577873664:0@lo:5: 00000100:00100000:2.0:1787599290.410265:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.410311:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.410362:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873664 00000100:00100000:1.0:1787599290.410370:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873664 00000100:00100000:1.0:1787599290.410426:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599290.410437:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577873664:12345-0@lo:5: 00002000:00080000:1.0:1787599290.410476:0:8629:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787599290.410526:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577873664:12345-0@lo:5: Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599290.410533:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787599290.412505:0:8624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138fb80 x1874433577873664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599290.412519:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577873664:0@lo:5: 00000004:00080000:3.0:1787599290.412530:0:8624:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787599290.412562:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577873792:0@lo:5: 00000100:00100000:3.0:1787599290.412599:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.412628:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599290.412717:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873792 00000100:00100000:1.0:1787599290.412722:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873792 00000100:00100000:1.0:1787599290.412770:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599290.412780:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8624:x1874433577873792:12345-0@lo:5: 00002000:00080000:1.0:1787599290.412842:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:0.0:1787599290.415347:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787599290.415517:0:8628:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787599290.415541:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874048:0@lo:7: 00000100:00100000:3.0:1787599290.415595:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.415618:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599290.415711:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599290.415724:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577873920:0@lo:13: 00000100:00100000:2.0:1787599290.415767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599290.415988:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577873920 00000100:00100000:3.0:1787599290.415994:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577873920 00000100:00100000:3.0:1787599290.416054:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599290.416062:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577873920:12345-0@lo:13: 00002000:00000024:3.0:1787599290.416080:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:3.0:1787599290.416118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577873920:12345-0@lo:13: Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.416125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599290.416205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c3100 x1874433577873920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599290.416233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577873920:0@lo:13: 00000100:00080000:0.0:1787599290.416325:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599290.416729:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8624:x1874433577873792:12345-0@lo:5: Request processed in 3950us (4128us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787599290.416737:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599290.416763:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874048 00000100:00100000:1.0:1787599290.416766:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874048 00000100:00100000:1.0:1787599290.416821:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599290.416829:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8628:x1874433577874048:12345-0@lo:7: 00010000:00080000:3.0:1787599290.423754:0:8624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c3b80 x1874433577873792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599290.423775:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8624:1874433577873792:0@lo:5: 00000004:00080000:3.0:1787599290.423809:0:8624:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787599290.424060:0:8624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8624:1874433577874176:0@lo:900: 00000100:00100000:2.0:1787599290.424118:0:8624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.424156:0:8624:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599290.424225:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874176 00000100:00100000:0.0:1787599290.424231:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874176 00000100:00100000:0.0:1787599290.424282:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599290.424292:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8624:x1874433577874176:12345-0@lo:900: 00000100:00100000:0.0:1787599290.424354:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8624:x1874433577874176:12345-0@lo:900: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.424362:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599290.424507:0:8624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138d880 x1874433577874176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599290.424518:0:8624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8624:1874433577874176:0@lo:900: 00002000:00080000:0.0:1787599290.428372:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787599290.428380:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787599290.428519:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8628:x1874433577874048:12345-0@lo:7: Request processed in 11687us (12920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599290.428529:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787599290.431631:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c0e00 x1874433577874048/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599290.431649:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874048:0@lo:7: 00000004:00080000:3.0:1787599290.431663:0:8628:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787599290.433859:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874304:0@lo:5: 00000100:00100000:2.0:1787599290.433924:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.433966:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.434310:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874304 00000100:00100000:3.0:1787599290.434318:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874304 00000100:00100000:3.0:1787599290.434372:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599290.434391:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8628:x1874433577874304:12345-0@lo:5: 00002000:00080000:3.0:1787599290.434440:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787599290.434445:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787599290.439428:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787599290.439446:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787599290.440403:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787599290.440826:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8628:x1874433577874304:12345-0@lo:5: Request processed in 6432us (6896us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787599290.440839:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787599290.441186:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ea00 x1874433577874304/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599290.441199:0:8628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787599290.441213:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874304:0@lo:5: 00000004:00080000:2.0:1787599290.441228:0:8628:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787599290.441272:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874432:0@lo:700: 00000100:00100000:2.0:1787599290.441635:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.441686:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.441756:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874432 00000100:00100000:3.0:1787599290.441762:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874432 00000100:00100000:3.0:1787599290.441820:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599290.441829:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8628:x1874433577874432:12345-0@lo:700: 00000100:00100000:3.0:1787599290.454060:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8628:x1874433577874432:12345-0@lo:700: Request processed in 12222us (12416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599290.454084:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599290.454184:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ea00 x1874433577874432/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599290.454199:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874432:0@lo:700: 00000004:02000040:2.0:1787599290.458007:0:8628:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787599290.461652:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874560:0@lo:5: 00000100:00100000:2.0:1787599290.462165:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599290.462244:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599290.462661:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874560 00000100:00100000:3.0:1787599290.462680:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874560 00000100:00100000:3.0:1787599290.462734:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599290.462751:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8628:x1874433577874560:12345-0@lo:5: 00002000:00080000:2.0:1787599290.475069:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787599290.475088:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787599290.487615:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8628:x1874433577874560:12345-0@lo:5: Request processed in 24859us (25444us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787599290.487626:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787599290.488171:0:8628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ea00 x1874433577874560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599290.488188:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8628:1874433577874560:0@lo:5: 00000004:00080000:2.0:1787599290.488203:0:8628:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1787599290.606124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599291.621299:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599291.947492:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577874688:0@lo:41: 00000100:00100000:0.0:1787599291.947574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599291.947682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874688 00000100:00100000:0.0:1787599291.947691:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874688 00000100:00100000:0.0:1787599291.947740:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599291.947749:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577874688:12345-0@lo:41: 00000004:00000024:0.0:1787599291.947785:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787599291.947846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577874688:12345-0@lo:41: Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599291.947854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599291.947912:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577874688:0@lo:41: 00010000:00010000:1.0:1787599292.645045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599293.478005:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577874816:0@lo:41: 00000100:00100000:3.0:1787599293.478084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599293.485321:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874816 00000100:00100000:3.0:1787599293.485345:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874816 00000100:00100000:3.0:1787599293.485419:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599293.485430:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577874816:12345-0@lo:41: 00000004:00000024:3.0:1787599293.485488:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787599293.485618:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577874816:12345-0@lo:41: Request processed in 189us (7534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599293.485625:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599293.485687:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577874816:0@lo:41: 00010000:00010000:2.0:1787599293.677236:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599294.025698:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787599294.693144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787599295.033248:0:8863:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599295.033627:0:8863:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787599295.525283:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577875200:0@lo:400: 00000100:00100000:0.0:1787599295.525283:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577874944:0@lo:400: 00000100:00100000:2.0:1787599295.526992:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577875328:0@lo:400: 00000100:00100000:1.0:1787599295.527118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599295.527330:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577875712:0@lo:400: 00000100:00100000:1.0:1787599295.527360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599295.527400:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577876224:0@lo:13: 00000100:00100000:1.0:1787599295.527424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599295.527464:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875200 00000100:00100000:1.0:1787599295.527472:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875200 00000100:00100000:1.0:1787599295.527519:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599295.527528:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577875200:12345-0@lo:400: 00000100:00100000:1.0:1787599295.527585:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577875200:12345-0@lo:400: Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.527609:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599295.527649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875712 00000100:00100000:1.0:1787599295.527653:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875712 00000100:00100000:1.0:1787599295.527691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599295.527698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577875712:12345-0@lo:400: 00000100:00100000:1.0:1787599295.527730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577875712:12345-0@lo:400: Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.527735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599295.527756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876224 00000100:00100000:1.0:1787599295.527760:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876224 00000100:00100000:1.0:1787599295.527786:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599295.527813:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577876224:12345-0@lo:13: 00002000:00000024:1.0:1787599295.527839:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599295.527871:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577876224:12345-0@lo:13: Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.527876:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787599295.527895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599295.527900:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787599295.527948:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c1880 x1874433577876224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599295.527959:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787599295.529283:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577876224:0@lo:13: 00000100:00100000:1.0:1787599295.529316:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577875200:0@lo:400: 00010000:00080000:1.0:1787599295.529328:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afea00 x1874433577875712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599295.529339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577875712:0@lo:400: 00000100:00100000:2.0:1787599295.529428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599295.529463:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577875840:0@lo:400: 00000100:00100000:2.0:1787599295.529492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599295.529531:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577875072:0@lo:400: 00000100:00100000:2.0:1787599295.529554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599295.529570:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577875584:0@lo:400: 00000100:00100000:2.0:1787599295.529594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599295.529607:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577876096:0@lo:13: 00000100:00100000:0.0:1787599295.529890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599295.529923:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577875456:0@lo:400: 00000100:00100000:0.0:1787599295.529947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599295.529962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577875968:0@lo:400: 00000100:00100000:0.0:1787599295.529983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599295.530015:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875840 00000100:00100000:0.0:1787599295.530021:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875840 00000100:00100000:0.0:1787599295.530053:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875968 00000100:00100000:0.0:1787599295.530056:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875968 00000100:00100000:0.0:1787599295.530079:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599295.530086:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577875840:12345-0@lo:400: 00000100:00100000:0.0:1787599295.530128:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577875840:12345-0@lo:400: Request processed in 43us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599295.530135:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599295.530148:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599295.530153:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577875968:12345-0@lo:400: 00000100:00100000:0.0:1787599295.530180:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577875968:12345-0@lo:400: Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599295.530185:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599295.530200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577874944 00000100:00100000:0.0:1787599295.530203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577874944 00000100:00100000:0.0:1787599295.530223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787599295.530229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433577874944:12345-0@lo:400: 00000100:00100000:0.0:1787599295.530266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433577874944:12345-0@lo:400: Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599295.530285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787599295.530312:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875456 00000100:00100000:0.0:1787599295.530315:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875456 00000100:00100000:0.0:1787599295.530335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599295.530341:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577875456:12345-0@lo:400: 00000100:00100000:0.0:1787599295.530371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577875456:12345-0@lo:400: Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599295.530377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787599295.530750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afd500 x1874433577875840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599295.530761:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577875840:0@lo:400: 00000100:00100000:1.0:1787599295.531260:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875328 00000100:00100000:1.0:1787599295.531265:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875328 00000100:00100000:1.0:1787599295.531286:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875072 00000100:00100000:1.0:1787599295.531289:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875072 00000100:00100000:1.0:1787599295.531297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577875584 00000100:00100000:1.0:1787599295.531299:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577875584 00000100:00100000:1.0:1787599295.531313:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599295.531320:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577875328:12345-0@lo:400: 00000100:00100000:1.0:1787599295.531359:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577875328:12345-0@lo:400: Request processed in 39us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.531364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599295.531375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599295.531381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577875072:12345-0@lo:400: 00000100:00100000:1.0:1787599295.531404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577875072:12345-0@lo:400: Request processed in 24us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.531409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599295.531418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599295.531423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577875584:12345-0@lo:400: 00000100:00100000:1.0:1787599295.531446:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577875584:12345-0@lo:400: Request processed in 23us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.531451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787599295.531472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599295.531476:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599295.531850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787599295.531892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e03480 x1874433577875072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599295.531913:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577875072:0@lo:400: 00010000:00080000:2.0:1787599295.531927:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afe680 x1874433577875584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599295.531935:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577875584:0@lo:400: 00000100:00100000:1.0:1787599295.532048:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876096 00000100:00100000:1.0:1787599295.532053:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876096 00000100:00100000:1.0:1787599295.532076:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599295.532083:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577876096:12345-0@lo:13: 00002000:00000024:1.0:1787599295.532098:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787599295.532133:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b345e00a80 x1874433577875328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599295.532143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577875328:0@lo:400: 00000100:00100000:0.0:1787599295.532168:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577874944:0@lo:400: 00000100:00100000:0.0:1787599295.532178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577875456:0@lo:400: 00010000:00080000:0.0:1787599295.532188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afd880 x1874433577875968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599295.532196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577875968:0@lo:400: 00000100:00100000:1.0:1787599295.532902:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577876096:12345-0@lo:13: Request processed in 816us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599295.532910:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787599295.533227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138dc00 x1874433577876096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599295.533244:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577876096:0@lo:13: 00010000:00010000:3.0:1787599295.725237:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787599295.866760:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1787599296.741134:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599297.061991:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577876352:0@lo:41: 00000100:00100000:0.0:1787599297.062077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599297.062202:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876352 00000100:00100000:2.0:1787599297.062210:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876352 00000100:00100000:2.0:1787599297.062262:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599297.062274:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577876352:12345-0@lo:41: 00000004:00000024:2.0:1787599297.062310:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787599297.062363:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577876352:12345-0@lo:41: Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599297.062370:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599297.062416:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577876352:0@lo:41: 00010000:00010000:2.0:1787599297.766601:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599297.835436:0:8965:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599297.835759:0:8965:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787599298.597077:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599298.597106:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577876480:0@lo:41: 00000100:00100000:1.0:1787599298.597183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599298.597264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876480 00000100:00100000:1.0:1787599298.597273:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876480 00000100:00100000:1.0:1787599298.597329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599298.598081:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577876480:12345-0@lo:41: 00000004:00000024:1.0:1787599298.598132:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787599298.598188:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577876480:12345-0@lo:41: Request processed in 850us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599298.598197:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599298.598426:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577876480:0@lo:41: 00010000:00010000:1.0:1787599298.792050:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787599299.101376:0:9013:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599299.101386:0:9013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1787599299.813041:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599300.647520:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577876608:0@lo:13: 00000100:00100000:1.0:1787599300.649194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599300.650055:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577876736:0@lo:13: 00000100:00100000:1.0:1787599300.650812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599300.650856:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876608 00000100:00100000:1.0:1787599300.650863:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876608 00000100:00100000:1.0:1787599300.650902:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876736 00000100:00100000:1.0:1787599300.650905:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876736 00000100:00100000:1.0:1787599300.650922:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599300.650930:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577876608:12345-0@lo:13: 00002000:00000024:1.0:1787599300.650971:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599300.651019:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577876608:12345-0@lo:13: Request processed in 90us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.651026:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599300.651043:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599300.651959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577876736:12345-0@lo:13: 00002000:00000024:1.0:1787599300.651973:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599300.652013:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577876736:12345-0@lo:13: Request processed in 963us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.652019:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787599300.652039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599300.652067:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419be300 x1874433577876736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599300.652078:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787599300.652098:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577876736:0@lo:13: 00010000:00080000:1.0:1787599300.652122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419bc700 x1874433577876608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599300.652135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577876608:0@lo:13: 00000100:00100000:0.0:1787599300.652359:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577876992:0@lo:400: 00000100:00100000:0.0:1787599300.652393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599300.653383:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577877504:0@lo:400: 00000100:00100000:0.0:1787599300.653411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599300.653433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787599300.653440:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577877120:0@lo:400: 00000100:00100000:1.0:1787599300.653509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577877248:0@lo:400: 00000100:00100000:1.0:1787599300.654628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599300.654668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599300.654676:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577876864:0@lo:400: 00000100:00100000:1.0:1787599300.654706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599300.654737:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577877376:0@lo:400: 00000100:00100000:2.0:1787599300.655111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876864 00000100:00100000:2.0:1787599300.655119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876864 00000100:00100000:2.0:1787599300.655173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787599300.655182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3647:x1874433577876864:12345-0@lo:400: 00000100:00100000:2.0:1787599300.655236:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3647:x1874433577876864:12345-0@lo:400: Request processed in 56us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599300.655243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599300.658322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599300.658385:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577876864:0@lo:400: 00000100:00100000:1.0:1787599300.658432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577876992 00000100:00100000:1.0:1787599300.658440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577876992 00000100:00100000:1.0:1787599300.658475:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877504 00000100:00100000:1.0:1787599300.658479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877504 00000100:00100000:1.0:1787599300.658503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877248 00000100:00100000:1.0:1787599300.658506:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877248 00000100:00100000:1.0:1787599300.658519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599300.658528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577876992:12345-0@lo:400: 00000100:00100000:1.0:1787599300.658594:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577876992:12345-0@lo:400: Request processed in 67us (6200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.658602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599300.658617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599300.658623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577877504:12345-0@lo:400: 00000100:00100000:1.0:1787599300.658650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577877504:12345-0@lo:400: Request processed in 28us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.658655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599300.658665:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599300.658671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577877248:12345-0@lo:400: 00000100:00100000:1.0:1787599300.658699:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577877248:12345-0@lo:400: Request processed in 29us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.658705:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787599300.658719:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787599300.658809:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afea00 x1874433577877248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599300.658824:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577877248:0@lo:400: 00000100:00100000:2.0:1787599300.659272:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877376 00000100:00100000:2.0:1787599300.659285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877376 00000100:00100000:2.0:1787599300.659875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599300.659885:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577877376:12345-0@lo:400: 00000100:00100000:2.0:1787599300.659938:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577877376:12345-0@lo:400: Request processed in 55us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599300.659944:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599300.660671:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577877376:0@lo:400: 00000100:00100000:0.0:1787599300.661049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599300.661129:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577877632:0@lo:400: 00000100:00100000:0.0:1787599300.661172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787599300.661207:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afd500 x1874433577876992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599300.661219:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577876992:0@lo:400: 00010000:00080000:0.0:1787599300.661231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343044380 x1874433577877504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599300.661239:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577877504:0@lo:400: 00000100:00100000:1.0:1787599300.661890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877632 00000100:00100000:1.0:1787599300.661898:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877632 00000100:00100000:1.0:1787599300.661946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599300.661955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577877632:12345-0@lo:400: 00000100:00100000:1.0:1787599300.661997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577877632:12345-0@lo:400: Request processed in 44us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.662004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787599300.663886:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787599300.663921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343047100 x1874433577877632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599300.663936:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577877632:0@lo:400: 00000100:00100000:2.0:1787599300.665125:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877120 00000100:00100000:2.0:1787599300.665133:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877120 00000100:00100000:2.0:1787599300.665212:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599300.665221:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577877120:12345-0@lo:400: 00000100:00100000:2.0:1787599300.665304:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577877120:12345-0@lo:400: Request processed in 84us (4255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599300.665311:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787599300.665376:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577877120:0@lo:400: 00010000:00010000:1.0:1787599300.837297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599301.861998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599302.190716:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599302.191053:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577877760:0@lo:41: 00000100:00100000:0.0:1787599302.191215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599302.191513:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877760 00000100:00100000:1.0:1787599302.191527:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877760 00000100:00100000:1.0:1787599302.192064:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787599302.192080:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577877760:12345-0@lo:41: 00000004:00000024:1.0:1787599302.193687:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787599302.194707:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577877760:12345-0@lo:41: Request processed in 2624us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599302.194723:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599302.196021:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577877760:0@lo:41: 00010000:00010000:3.0:1787599302.886219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599303.719072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599303.719109:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577877888:0@lo:41: 00000100:00100000:2.0:1787599303.719186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599303.725247:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577877888 00000100:00100000:3.0:1787599303.725266:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577877888 00000100:00100000:3.0:1787599303.725345:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599303.725365:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577877888:12345-0@lo:41: 00000004:00000024:3.0:1787599303.725420:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787599303.725588:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577877888:12345-0@lo:41: Request processed in 233us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599303.725595:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599303.730188:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577877888:0@lo:41: 00010000:00010000:3.0:1787599303.908936:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599304.934141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599305.765676:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577878016:0@lo:13: 00000100:00100000:0.0:1787599305.765968:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577878272:0@lo:400: 00000100:00100000:0.0:1787599305.766030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599305.766137:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577878784:0@lo:400: 00000100:00100000:0.0:1787599305.766158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599305.766187:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599305.766192:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577878400:0@lo:400: 00000100:00100000:0.0:1787599305.766212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599305.766225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577878912:0@lo:400: 00000100:00100000:0.0:1787599305.766241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599305.766268:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878272 00000100:00100000:0.0:1787599305.766275:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878272 00000100:00100000:0.0:1787599305.766307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878784 00000100:00100000:0.0:1787599305.766309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878784 00000100:00100000:0.0:1787599305.766326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878912 00000100:00100000:0.0:1787599305.766328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878912 00000100:00100000:0.0:1787599305.766341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599305.766349:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577878272:12345-0@lo:400: 00000100:00100000:0.0:1787599305.766396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577878272:12345-0@lo:400: Request processed in 47us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.766402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599305.766416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599305.766421:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577878784:12345-0@lo:400: 00000100:00100000:0.0:1787599305.766442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577878784:12345-0@lo:400: Request processed in 21us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.766459:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599305.766469:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599305.766475:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577878912:12345-0@lo:400: 00000100:00100000:0.0:1787599305.766497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577878912:12345-0@lo:400: Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.766503:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599305.766520:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878400 00000100:00100000:0.0:1787599305.766523:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878400 00000100:00100000:0.0:1787599305.766557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599305.766564:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577878400:12345-0@lo:400: 00000100:00100000:0.0:1787599305.766592:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577878400:12345-0@lo:400: Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.766598:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787599305.766613:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599305.766618:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599305.766640:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577878400:0@lo:400: 00010000:00080000:0.0:1787599305.766651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343045c00 x1874433577878912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599305.766662:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577878912:0@lo:400: 00010000:00080000:0.0:1787599305.766669:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343046a00 x1874433577878272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599305.766677:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577878272:0@lo:400: 00010000:00080000:0.0:1787599305.766684:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343044700 x1874433577878784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599305.766691:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577878784:0@lo:400: 00000100:00100000:1.0:1787599305.766823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.766850:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577878528:0@lo:400: 00000100:00100000:1.0:1787599305.766870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.766882:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577879040:0@lo:400: 00000100:00100000:1.0:1787599305.766901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.766921:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599305.766926:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577878144:0@lo:400: 00000100:00100000:1.0:1787599305.766947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.766973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577878656:0@lo:400: 00000100:00100000:1.0:1787599305.766992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.767004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577879168:0@lo:400: 00000100:00100000:1.0:1787599305.767020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599305.767048:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878016 00000100:00100000:1.0:1787599305.767183:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878016 00000100:00100000:1.0:1787599305.767217:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599305.767224:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577878016:12345-0@lo:13: 00002000:00000024:1.0:1787599305.767258:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599305.767291:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577878016:12345-0@lo:13: Request processed in 68us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599305.767297:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599305.767314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878144 00000100:00100000:1.0:1787599305.767316:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878144 00000100:00100000:1.0:1787599305.767340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787599305.767346:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433577878144:12345-0@lo:400: 00000100:00100000:1.0:1787599305.767370:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433577878144:12345-0@lo:400: Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599305.767375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787599305.767399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878656 00000100:00100000:1.0:1787599305.767402:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878656 00000100:00100000:1.0:1787599305.767423:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599305.767428:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577878656:12345-0@lo:400: 00000100:00100000:1.0:1787599305.767452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577878656:12345-0@lo:400: Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599305.767458:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599305.767652:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577878528 00000100:00100000:0.0:1787599305.767655:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577878528 00000100:00100000:0.0:1787599305.767678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599305.767686:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577878528:12345-0@lo:400: 00000100:00100000:0.0:1787599305.767875:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577878528:12345-0@lo:400: Request processed in 189us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.767882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599305.767900:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879040 00000100:00100000:0.0:1787599305.767904:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879040 00000100:00100000:0.0:1787599305.767927:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879168 00000100:00100000:0.0:1787599305.767929:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879168 00000100:00100000:0.0:1787599305.767942:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599305.767948:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577879040:12345-0@lo:400: 00000100:00100000:0.0:1787599305.767978:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577879040:12345-0@lo:400: Request processed in 30us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.767983:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599305.767993:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599305.767998:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577879168:12345-0@lo:400: 00000100:00100000:0.0:1787599305.768021:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577879168:12345-0@lo:400: Request processed in 23us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.768027:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787599305.768044:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599305.768416:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577879296:0@lo:13: 00000100:00100000:3.0:1787599305.768451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599305.768486:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879296 00000100:00100000:3.0:1787599305.768490:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879296 00000100:00100000:3.0:1787599305.768516:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599305.768524:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577879296:12345-0@lo:13: 00002000:00000024:3.0:1787599305.768554:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599305.768586:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577879296:12345-0@lo:13: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599305.768593:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787599305.768629:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c2300 x1874433577879296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599305.768647:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577879296:0@lo:13: 00000100:00100000:1.0:1787599305.768884:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577878144:0@lo:400: 00000100:00100000:1.0:1787599305.768912:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577878656:0@lo:400: 00010000:00080000:1.0:1787599305.768924:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343046d80 x1874433577879168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599305.768932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577879168:0@lo:400: 00010000:00080000:1.0:1787599305.768943:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343045500 x1874433577878528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599305.768951:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577878528:0@lo:400: 00010000:00080000:1.0:1787599305.768960:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b343045180 x1874433577879040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599305.768967:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577879040:0@lo:400: 00010000:00080000:1.0:1787599305.768976:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419bc380 x1874433577878016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599305.768987:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577878016:0@lo:13: 00010000:00010000:3.0:1787599305.962443:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599306.992032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599307.301147:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599307.301182:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577879424:0@lo:41: 00000100:00100000:1.0:1787599307.301285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599307.301439:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879424 00000100:00100000:0.0:1787599307.301450:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879424 00000100:00100000:0.0:1787599307.301529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599307.301541:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577879424:12345-0@lo:41: 00000004:00000024:0.0:1787599307.301586:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787599307.301662:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577879424:12345-0@lo:41: Request processed in 122us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599307.301670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787599307.303782:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577879424:0@lo:41: 00010000:00010000:3.0:1787599308.006894:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599308.836962:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599308.836999:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577879552:0@lo:41: 00000100:00100000:2.0:1787599308.837105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599308.837266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879552 00000100:00100000:0.0:1787599308.837277:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879552 00000100:00100000:0.0:1787599308.837346:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599308.837359:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577879552:12345-0@lo:41: 00000004:00000024:0.0:1787599308.837409:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787599308.837480:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577879552:12345-0@lo:41: Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599308.837488:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599308.837554:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577879552:0@lo:41: 00010000:00010000:3.0:1787599309.037092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599310.056311:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599310.887616:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599310.887662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577879680:0@lo:13: 00000100:00100000:3.0:1787599310.887766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.887935:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879680 00000100:00100000:2.0:1787599310.887948:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879680 00000100:00100000:2.0:1787599310.888042:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599310.888054:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577879680:12345-0@lo:13: 00002000:00000024:2.0:1787599310.888092:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599310.888164:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577879680:12345-0@lo:13: Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.888181:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787599310.888235:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138f480 x1874433577879680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599310.888257:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577879680:0@lo:13: 00000100:00080000:3.0:1787599310.888480:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599310.888723:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599310.888738:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577879808:0@lo:13: 00000100:00100000:3.0:1787599310.888777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.888881:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879808 00000100:00100000:2.0:1787599310.888887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879808 00000100:00100000:2.0:1787599310.888931:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599310.888940:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577879808:12345-0@lo:13: 00002000:00000024:2.0:1787599310.888954:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599310.888989:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577879808:12345-0@lo:13: Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.888995:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787599310.889034:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138f480 x1874433577879808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599310.889050:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577879808:0@lo:13: 00000100:00080000:3.0:1787599310.889187:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599310.890377:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577880192:0@lo:400: 00000100:00100000:2.0:1787599310.890434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.890466:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577880704:0@lo:400: 00000100:00100000:2.0:1787599310.890515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.890542:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599310.890547:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577880064:0@lo:400: 00000100:00100000:2.0:1787599310.890570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.890590:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577880576:0@lo:400: 00000100:00100000:2.0:1787599310.890611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599310.890665:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880192 00000100:00100000:2.0:1787599310.890675:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880192 00000100:00100000:2.0:1787599310.890723:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599310.890733:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577880192:12345-0@lo:400: 00000100:00100000:2.0:1787599310.890789:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577880192:12345-0@lo:400: Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.890822:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599310.890850:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880704 00000100:00100000:2.0:1787599310.890853:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880704 00000100:00100000:2.0:1787599310.890887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880064 00000100:00100000:2.0:1787599310.890890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880064 00000100:00100000:2.0:1787599310.890905:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880576 00000100:00100000:2.0:1787599310.890907:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880576 00000100:00100000:2.0:1787599310.890923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599310.890929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577880704:12345-0@lo:400: 00000100:00100000:2.0:1787599310.890962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577880704:12345-0@lo:400: Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.890969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599310.890982:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599310.890987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577880064:12345-0@lo:400: 00000100:00100000:2.0:1787599310.891013:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577880064:12345-0@lo:400: Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.891019:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599310.891230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599310.891238:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577880576:12345-0@lo:400: 00000100:00100000:2.0:1787599310.891269:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577880576:12345-0@lo:400: Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.891275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787599310.891315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599310.891320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787599310.891354:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138ea00 x1874433577880064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599310.891369:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577880064:0@lo:400: 00010000:00080000:2.0:1787599310.891382:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241091f80 x1874433577880576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599310.891391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577880576:0@lo:400: 00000100:00100000:2.0:1787599310.891401:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577880192:0@lo:400: 00010000:00080000:2.0:1787599310.891410:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241091880 x1874433577880704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599310.891418:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577880704:0@lo:400: 00000100:00100000:3.0:1787599310.891585:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577879936:0@lo:400: 00000100:00100000:3.0:1787599310.891628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599310.891678:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577880448:0@lo:400: 00000100:00100000:3.0:1787599310.891704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599310.891728:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599310.891735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577880320:0@lo:400: 00000100:00100000:3.0:1787599310.891759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599310.891787:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880448 00000100:00100000:3.0:1787599310.891816:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880448 00000100:00100000:3.0:1787599310.891850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599310.891858:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577880448:12345-0@lo:400: 00000100:00100000:3.0:1787599310.891895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577880448:12345-0@lo:400: Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599310.891902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599310.891931:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577880448:0@lo:400: 00000100:00100000:3.0:1787599310.891948:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880320 00000100:00100000:3.0:1787599310.891951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880320 00000100:00100000:3.0:1787599310.891973:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599310.891980:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577880320:12345-0@lo:400: 00000100:00100000:3.0:1787599310.892017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577880320:12345-0@lo:400: Request processed in 37us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599310.892023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787599310.892065:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241093100 x1874433577880320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599310.892085:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577880320:0@lo:400: 00000100:00100000:2.0:1787599310.895224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577879936 00000100:00100000:2.0:1787599310.895248:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577879936 00000100:00100000:2.0:1787599310.895344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787599310.895358:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3648:x1874433577879936:12345-0@lo:400: 00000100:00100000:2.0:1787599310.895508:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3648:x1874433577879936:12345-0@lo:400: Request processed in 152us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.895516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787599310.895596:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577879936:0@lo:400: 00010000:00010000:3.0:1787599311.082121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.109256:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787599312.309249:0:9513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787599312.309254:0:9513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787599312.309256:0:9513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787599312.309401:0:9513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b37f896800 00000020:01000004:0.0:1787599312.309417:0:9513:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787599312.309433:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787599312.309456:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96b242c38000) 00000020:00000080:0.0:1787599312.309476:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787599312.405608:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787599312.405668:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00000100:00100000:1.0:1787599312.425316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577880832:0@lo:41: 00000100:00100000:1.0:1787599312.425394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.425703:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880832 00000100:00100000:0.0:1787599312.425712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880832 00000100:00100000:0.0:1787599312.425775:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599312.425916:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577880832:12345-0@lo:41: 00000004:00000024:0.0:1787599312.425954:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787599312.426016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577880832:12345-0@lo:41: Request processed in 231us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599312.426024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599312.426120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577880832:0@lo:41: 00080000:01000000:2.0:1787599312.440008:0:9513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787599312.440206:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787599312.440218:0:9513:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599312.440232:0:9513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929cf15c 00000020:01000004:2.0:1787599312.440238:0:9513:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787599312.440258:0:9513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599312.440262:0:9513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599312.440267:0:9513:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787599312.440301:0:9513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787599312.440304:0:9513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787599312.462398:0:9513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599312.462519:0:9513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787599312.462524:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599312.462526:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599312.462527:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599312.462529:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599312.462530:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599312.462532:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599312.462533:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599312.462535:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599312.462536:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599312.462538:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599312.462540:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599312.462543:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787599312.462547:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599312.462548:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599312.462549:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599312.462550:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599312.462551:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599312.462552:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599312.462553:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599312.462554:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599312.462556:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599312.462556:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599312.462557:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599312.462587:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787599312.462606:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577880960:0@lo:253: 00000100:00100000:2.0:1787599312.462749:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.463044:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599312.463094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577880960 00000100:00100000:1.0:1787599312.463103:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577880960 00000100:00100000:1.0:1787599312.463197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599312.463206:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:9513:x1874433577880960:12345-0@lo:253: 20000000:01000000:1.0:1787599312.463236:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787599312.463240:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787599312.463246:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787599312.463249:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787599312.463487:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599312.463610:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1787599312.463626:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787599312.463726:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1787599312.463734:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787599312.463750:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1787599312.463763:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1787599312.464118:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1787599312.464134:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:1.0:1787599312.464136:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787599312.464149:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1787599312.464155:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787599312.464169:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1787599312.464174:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1787599312.464188:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1787599312.464194:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787599312.464206:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1787599312.464222:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1787599312.464295:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1787599312.464305:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:1.0:1787599312.464307:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787599312.464321:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1787599312.464327:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787599312.464340:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1787599312.464345:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1787599312.464370:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1787599312.464378:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787599312.464391:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1787599312.464472:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1787599312.465016:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1787599312.465029:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:1.0:1787599312.465031:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787599312.465046:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1787599312.465053:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787599312.465065:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1787599312.465070:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1787599312.465102:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1787599312.465109:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787599312.465122:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1787599312.465136:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1787599312.465147:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787599312.465150:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787599312.465154:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787599312.465195:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787599312.465197:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599312.465885:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599312.465926:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599312.465938:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787599312.466228:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787599312.466249:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1787599312.466263:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1787599312.466272:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787599312.466274:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787599312.466584:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1787599312.466601:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1787599312.466616:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787599312.466856:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787599312.466874:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787599312.466886:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787599312.466896:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787599312.466898:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599312.467279:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1787599312.467424:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1787599312.467444:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1787599312.467459:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1787599312.467470:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787599312.467487:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599312.467936:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599312.467955:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599312.467969:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1787599312.468105:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1787599312.468125:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1787599312.468139:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1787599312.468149:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787599312.468151:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599312.468428:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599312.468450:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599312.468465:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787599312.468709:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787599312.468733:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787599312.468763:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1787599312.468780:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787599312.468935:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468955:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468962:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468969:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468976:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468982:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468989:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.468996:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.469010:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.469048:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.469063:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.469078:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881088:0@lo:104: 00000100:00100000:1.0:1787599312.469148:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599312.469244:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.469253:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.469263:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881216:0@lo:104: 00000100:00100000:1.0:1787599312.469285:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599312.469437:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.469446:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.469454:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881344:0@lo:104: 00000100:00100000:1.0:1787599312.469485:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.469601:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881088 00000100:00100000:2.0:1787599312.469608:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881088 00000100:00100000:2.0:1787599312.469663:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881216 00000100:00100000:2.0:1787599312.469666:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881216 00000100:00100000:2.0:1787599312.469681:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599312.469690:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6514:x1874433577881088:12345-0@lo:104: 00010000:00010000:2.0:1787599312.469702:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.469751:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599312.469758:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6514:x1874433577881088:12345-0@lo:104: Request processed in 69us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.469765:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599312.469781:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599312.469786:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577881216:12345-0@lo:104: 00010000:00010000:2.0:1787599312.469871:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.469908:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599312.469914:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577881216:12345-0@lo:104: Request processed in 128us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.469920:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787599312.470454:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599312.470461:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470486:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.470490:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470499:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.470506:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.470513:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.470549:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470556:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.470574:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470581:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030200/0x5d2988b0929cf140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf14e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470593:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599312.470596:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470602:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.470605:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470621:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.470628:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.470634:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.470659:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470665:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.470679:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470686:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf124 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470695:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.470697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.470699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.470712:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577881472:0@lo:103: 00000100:00100000:1.0:1787599312.470743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.470785:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577881600:0@lo:103: 00000100:00100000:1.0:1787599312.470835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.470864:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881472 00000100:00100000:1.0:1787599312.470869:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881472 00010000:00010000:1.0:1787599312.470888:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.470918:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881600 00000100:00100000:1.0:1787599312.470921:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881600 00010000:00010000:1.0:1787599312.470933:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 23 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.470945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599312.470952:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3648:x1874433577881472:12345-0@lo:103: 00010000:00010000:1.0:1787599312.470962:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.470966:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 23 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470976:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 23 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.470991:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.471018:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3648:x1874433577881472:12345-0@lo:103: Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599312.471040:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599312.471046:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3645:x1874433577881600:12345-0@lo:103: 00010000:00010000:1.0:1787599312.471052:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.471057:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471065:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471074:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.471106:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3645:x1874433577881600:12345-0@lo:103: Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471113:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599312.471153:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577881472:0@lo:103: 00000100:00100000:1.0:1787599312.471176:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577881600:0@lo:103: 00010000:00010000:1.0:1787599312.471198:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471209:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 21 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.471218:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881728:0@lo:104: 00000100:00100000:1.0:1787599312.471239:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.471262:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881344 00000100:00100000:1.0:1787599312.471266:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881344 00000100:00100000:1.0:1787599312.471281:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881728 00000100:00100000:1.0:1787599312.471284:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881728 00000100:00100000:1.0:1787599312.471293:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599312.471299:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6514:x1874433577881344:12345-0@lo:104: 00010000:00010000:1.0:1787599312.471308:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471338:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599312.471343:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6514:x1874433577881344:12345-0@lo:104: Request processed in 44us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471349:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599312.471360:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599312.471366:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577881728:12345-0@lo:104: 00010000:00010000:1.0:1787599312.471378:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471403:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599312.471408:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577881728:12345-0@lo:104: Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471414:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787599312.471428:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599312.471431:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471437:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.471441:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471447:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.471454:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.471459:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.471473:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471492:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.471504:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471511:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7c00/0x5d2988b0929cf101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471527:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599312.471530:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471535:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.471537:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471543:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.471549:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.471554:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.471583:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471590:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.471600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471607:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929cf0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.471617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.471618:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.471627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577881856:0@lo:103: 00000100:00100000:1.0:1787599312.471657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.471685:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577881984:0@lo:103: 00000100:00100000:1.0:1787599312.471710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.471734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881856 00000100:00100000:1.0:1787599312.471738:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881856 00010000:00010000:1.0:1787599312.471752:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 22 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.471769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577881984 00000100:00100000:1.0:1787599312.471772:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577881984 00010000:00010000:1.0:1787599312.471780:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 23 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.471813:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599312.471820:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3646:x1874433577881856:12345-0@lo:103: 00010000:00010000:1.0:1787599312.471828:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.471832:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 23 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471841:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 23 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471850:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.471877:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3646:x1874433577881856:12345-0@lo:103: Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471882:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599312.471895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599312.471901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3647:x1874433577881984:12345-0@lo:103: 00010000:00010000:1.0:1787599312.471909:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.471919:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 22 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471929:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 22 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.471937:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.471964:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3647:x1874433577881984:12345-0@lo:103: Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.471970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599312.472021:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577881984:0@lo:103: 00000100:00100000:1.0:1787599312.472041:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577881856:0@lo:103: 00010000:00010000:1.0:1787599312.472068:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472078:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 21 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.472087:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882112:0@lo:104: 00000100:00100000:1.0:1787599312.472108:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.472126:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882112 00000100:00100000:1.0:1787599312.472130:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882112 00000100:00100000:1.0:1787599312.472146:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599312.472151:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882112:12345-0@lo:104: 00010000:00010000:1.0:1787599312.472158:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472187:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599312.472193:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882112:12345-0@lo:104: Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.472205:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787599312.472221:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599312.472225:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472231:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d0c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.472235:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472242:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.472248:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.472254:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.472268:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472274:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.472284:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472290:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0c2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472301:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.472302:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.472304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.472310:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599312.472323:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577882240:0@lo:103: 00000100:00100000:1.0:1787599312.472347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.472370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882240 00000100:00100000:1.0:1787599312.472373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882240 00010000:00010000:1.0:1787599312.472387:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 22 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.472404:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599312.472410:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3647:x1874433577882240:12345-0@lo:103: 00010000:00010000:1.0:1787599312.472417:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.472421:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 22 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472430:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 22 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472439:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.472463:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3647:x1874433577882240:12345-0@lo:103: Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.472470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599312.472509:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577882240:0@lo:103: 00010000:00010000:1.0:1787599312.472531:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472541:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.472550:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882368:0@lo:104: 00000100:00100000:1.0:1787599312.472574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.472606:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787599312.472615:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882368 00000100:00100000:1.0:1787599312.472618:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882368 00000100:00100000:1.0:1787599312.472636:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599312.472642:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882368:12345-0@lo:104: 00010000:00010000:1.0:1787599312.472650:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472680:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599312.472685:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882368:12345-0@lo:104: Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.472690:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787599312.472721:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599312.472725:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472731:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031a00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.472735:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472741:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.472747:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.472753:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.472766:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472781:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.472814:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472821:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf07c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf083 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472833:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.472835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.472836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.472842:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599312.472849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577882496:0@lo:103: 00000100:00100000:1.0:1787599312.472873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.472897:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882496 00000100:00100000:1.0:1787599312.472901:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882496 00010000:00010000:1.0:1787599312.472914:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.472933:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599312.472939:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3646:x1874433577882496:12345-0@lo:103: 00010000:00010000:1.0:1787599312.472947:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599312.472951:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472961:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 22 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.472971:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.472997:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3646:x1874433577882496:12345-0@lo:103: Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.473021:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599312.473045:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577882496:0@lo:103: 00010000:00010000:1.0:1787599312.473069:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473078:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473088:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882624:0@lo:104: 00000100:00100000:1.0:1787599312.473111:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.473125:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93540 going to sleep for 11 seconds 00010000:00010000:1.0:1787599312.473139:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf14e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf140 expref: 21 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473150:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881088:0@lo:104: 00010000:00010000:1.0:1787599312.473162:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030800/0x5d2988b0929cf124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf11d expref: 20 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473172:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881216:0@lo:104: 00010000:00010000:1.0:1787599312.473182:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf101 expref: 19 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473191:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881344:0@lo:104: 00010000:00010000:1.0:1787599312.473202:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf0d7 expref: 18 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473210:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577881728:0@lo:104: 00010000:00010000:1.0:1787599312.473229:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031400/0x5d2988b0929cf0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf0bb expref: 17 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473237:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882112:0@lo:104: 00010000:00010000:1.0:1787599312.473244:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf07c expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599312.473254:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882368:0@lo:104: 00000100:00100000:1.0:1787599312.473266:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882624 00000100:00100000:1.0:1787599312.473269:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882624 00000100:00100000:1.0:1787599312.473287:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599312.473294:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882624:12345-0@lo:104: 00010000:00010000:1.0:1787599312.473301:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473335:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599312.473340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6514:x1874433577882624:12345-0@lo:104: Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.473346:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787599312.473358:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599312.473361:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473367:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d0e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599312.473370:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473377:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599312.473388:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599312.473393:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599312.473406:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473412:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599312.473421:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473428:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3821d0e00/0x5d2988b0929cf052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf059 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.473441:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.473442:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599312.473444:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.473449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599312.473458:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577882752:0@lo:103: 00010000:00010000:3.0:1787599312.474073:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599312.474210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599312.474312:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874433577882624:0@lo:104: 00010000:00010000:1.0:1787599312.474337:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599312.474379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882752 00000100:00100000:2.0:1787599312.474385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882752 00010000:00010000:2.0:1787599312.474491:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599312.474552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599312.474561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3645:x1874433577882752:12345-0@lo:103: 00010000:00010000:2.0:1787599312.474581:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599312.474586:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474596:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474611:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341496000/0x5d2988b0929cf059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf052 expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474627:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474635:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474721:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474729:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474735:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474742:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474748:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599312.474752:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.474771:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.475089:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.475098:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599312.475105:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787599312.475177:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.475186:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497000/0x5d2988b0929cf163 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.475200:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599312.476199:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3645:x1874433577882752:12345-0@lo:103: Request processed in 1635us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.476210:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599312.476327:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577882752:0@lo:103: 00000100:00100000:3.0:1787599312.478391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:9513:x1874433577880960:12345-0@lo:253: Request processed in 15178us (15634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.478416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787599312.478580:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577880960:0@lo:253: 10000000:01000000:2.0:1787599312.478596:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787599312.478600:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599312.478601:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599312.478603:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599312.478604:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787599312.478605:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599312.478606:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599312.478608:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599312.478609:0:9513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787599312.478610:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599312.478612:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787599312.478631:0:9513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b37f896800 from lustre-OST0001 10000000:01000000:2.0:1787599312.478726:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787599312.478730:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787599312.478739:0:9513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b34dcf99b8 local copy 10000000:01000000:2.0:1787599312.478744:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787599312.478779:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.479083:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.479093:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.479206:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577882880:0@lo:101: 00000100:00100000:0.0:1787599312.479248:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.479320:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599312.479356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577882880 00000100:00100000:1.0:1787599312.479369:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577882880 00000100:00100000:1.0:1787599312.479517:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787599312.479528:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+14:9513:x1874433577882880:12345-0@lo:101: 00010000:00010000:1.0:1787599312.479540:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599312.479555:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.479577:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf16a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.479587:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf16a expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599312.479597:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341497e00, rc 0) 00000100:00100000:1.0:1787599312.479645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577882880:12345-0@lo:101: Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599312.479652:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787599312.479711:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577882880:0@lo:101: 00010000:00010000:0.0:1787599312.479725:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.479733:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.479853:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883008:0@lo:501: 00000100:00100000:0.0:1787599312.479878:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.480190:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.480254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883008 00000100:00100000:2.0:1787599312.480260:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883008 00000100:00100000:2.0:1787599312.480289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787599312.480297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883008:12345-0@lo:501: 00000100:00100000:2.0:1787599312.480376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883008:12345-0@lo:501: Request processed in 79us (498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599312.480383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787599312.480783:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883008:0@lo:501: 10000000:01000000:0.0:1787599312.480837:0:9513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787599312.480868:0:9513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787599312.480874:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.480883:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.480890:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.480909:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787599312.480940:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b37f896800 10000000:01000000:0.0:1787599312.480945:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787599312.480951:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787599312.480953:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599312.480958:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787599312.480961:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787599312.480982:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.480989:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.480997:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.481011:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883136:0@lo:101: 00000100:00100000:0.0:1787599312.481044:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.481067:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.481183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883136 00000100:00100000:2.0:1787599312.481188:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883136 00000100:00100000:2.0:1787599312.481210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787599312.481218:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883136:12345-0@lo:101: 00010000:00010000:2.0:1787599312.481225:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599312.481235:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf178 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481250:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481258:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481266:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6c00, rc 0) 00000100:00100000:2.0:1787599312.481307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577883136:12345-0@lo:101: Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.481312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:2.0:1787599312.481337:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599312.481343:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481349:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599312.481353:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481360:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599312.481367:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599312.481372:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599312.481390:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481396:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599312.481427:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481434:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d2988b0929cf171 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481446:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599312.481447:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599312.481449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599312.481461:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599312.481472:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577883264:0@lo:103: 00000100:00100000:2.0:1787599312.481510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.481538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883264 00000100:00100000:2.0:1787599312.481542:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883264 00000100:00100000:2.0:1787599312.481571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599312.481578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3648:x1874433577883264:12345-0@lo:103: 00010000:00010000:2.0:1787599312.481588:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599312.481598:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497e00/0x5d2988b0929cf171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf16a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.481607:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599312.481632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3648:x1874433577883264:12345-0@lo:103: Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.481649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599312.481676:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577883264:0@lo:103: 00000100:00100000:0.0:1787599312.481962:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883136:0@lo:101: 00010000:00010000:0.0:1787599312.481983:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.481991:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.482055:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883392:0@lo:501: 00000100:00100000:0.0:1787599312.482086:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.482105:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.482151:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883392 00000100:00100000:2.0:1787599312.482156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883392 00000100:00100000:2.0:1787599312.482175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787599312.482181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883392:12345-0@lo:501: 00000100:00100000:2.0:1787599312.482283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883392:12345-0@lo:501: Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.482290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787599312.482496:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883392:0@lo:501: 00000100:00100000:0.0:1787599312.482521:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883520:0@lo:503: 00000100:00100000:0.0:1787599312.482560:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.482583:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.482623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883520 00000100:00100000:2.0:1787599312.482628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883520 00000100:00100000:2.0:1787599312.482655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787599312.482661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883520:12345-0@lo:503: 00000100:00100000:2.0:1787599312.482745:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883520:12345-0@lo:503: Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.482757:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787599312.482964:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883520:0@lo:503: 00000040:00080000:0.0:1787599312.483220:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599312.483288:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883648:0@lo:502: 00000100:00100000:0.0:1787599312.483321:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.483341:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.483428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883648 00000100:00100000:2.0:1787599312.483433:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883648 00000100:00100000:2.0:1787599312.483455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787599312.483462:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883648:12345-0@lo:502: 00000100:00100000:2.0:1787599312.483556:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883648:12345-0@lo:502: Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.483563:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787599312.483745:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883648:0@lo:502: 00000040:00080000:0.0:1787599312.483985:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787599312.484012:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787599312.484026:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787599312.484041:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787599312.484055:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787599312.484070:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787599312.484092:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883776:0@lo:502: 00000100:00100000:0.0:1787599312.484134:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.484155:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.484299:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883776 00000100:00100000:2.0:1787599312.484305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883776 00000100:00100000:2.0:1787599312.484328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787599312.484335:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883776:12345-0@lo:502: 00000100:00100000:2.0:1787599312.484416:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883776:12345-0@lo:502: Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.484423:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787599312.484562:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883776:0@lo:502: 00000040:00080000:0.0:1787599312.484601:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787599312.484609:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1787599312.485193:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787599312.485202:0:9524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787599312.485208:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599312.485211:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787599312.485216:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787599312.485231:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96b242c3b370) 00000020:00000080:0.0:1787599312.485255:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787599312.485261:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787599312.485327:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f896800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787599312.485335:0:9524:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787599312.485341:0:9524:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929cf18d 00010000:00010000:1.0:1787599312.491238:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1787599312.491972:0:9524:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787599312.495028:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787599312.495386:0:9524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787599312.500964:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787599312.501207:0:9524:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787599312.506018:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787599312.507598:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787599312.507610:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599312.507617:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599312.507620:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787599312.507622:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599312.507626:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599312.507628:0:9524:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599312.507631:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599312.507633:0:9524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599312.507772:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599312.507776:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599312.507778:0:9524:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787599312.507781:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787599312.508040:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787599312.508068:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787599312.508091:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508103:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599312.508111:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 1 10000000:01000000:2.0:1787599312.508113:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599312.508147:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508166:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508178:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599312.508199:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883904:0@lo:101: 00000100:00100000:2.0:1787599312.508261:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.508297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577883904 00000100:00100000:2.0:1787599312.508303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577883904 00000100:00100000:2.0:1787599312.508344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787599312.508354:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:9513:x1874433577883904:12345-0@lo:101: 00010000:00010000:2.0:1787599312.508366:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599312.508377:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf194 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508411:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508422:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508430:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6e00, rc 0) 00000100:00100000:2.0:1787599312.508461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577883904:12345-0@lo:101: Request processed in 108us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.508468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787599312.508517:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.508538:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577883904:0@lo:101: 00010000:00010000:2.0:1787599312.508558:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.508565:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599312.508781:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884032:0@lo:501: 00000100:00100000:2.0:1787599312.508898:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.508914:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.508929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884032 00000100:00100000:2.0:1787599312.508933:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884032 00000100:00100000:2.0:1787599312.508960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599312.508967:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884032:12345-0@lo:501: 00000100:00100000:2.0:1787599312.509056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884032:12345-0@lo:501: Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.509063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599312.509095:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884032:0@lo:501: 00000100:00100000:2.0:1787599312.509118:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884160:0@lo:503: 00000100:00100000:2.0:1787599312.509155:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.509175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884160 00000100:00100000:2.0:1787599312.509179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884160 00000100:00100000:2.0:1787599312.509200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599312.509206:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884160:12345-0@lo:503: 00000100:00100000:2.0:1787599312.509275:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884160:12345-0@lo:503: Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.509281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599312.509318:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.509329:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884160:0@lo:503: 00000040:00080000:2.0:1787599312.510745:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599312.512615:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884288:0@lo:502: 00000100:00100000:2.0:1787599312.513590:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.513953:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.513985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884288 00000100:00100000:2.0:1787599312.513993:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884288 00000100:00100000:2.0:1787599312.514046:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787599312.514055:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884288:12345-0@lo:502: 00000100:00100000:2.0:1787599312.514196:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884288:12345-0@lo:502: Request processed in 141us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.514204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787599312.514264:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884288:0@lo:502: 00000040:00080000:2.0:1787599312.515051:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787599312.515087:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787599312.515123:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884416:0@lo:502: 00000100:00100000:2.0:1787599312.515173:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.515211:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599312.515453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884416 00000100:00100000:3.0:1787599312.515461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884416 00000100:00100000:3.0:1787599312.515511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787599312.515521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884416:12345-0@lo:502: 00000100:00100000:3.0:1787599312.515629:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884416:12345-0@lo:502: Request processed in 109us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.515635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787599312.516314:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884416:0@lo:502: 00000040:00080000:2.0:1787599312.516389:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787599312.516411:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787599312.517095:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599312.517106:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599312.517108:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787599312.517114:0:9528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f896800 00000020:00000080:2.0:1787599312.517118:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599312.517141:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599312.517145:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599312.517146:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787599312.517150:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787599312.517262:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787599312.517291:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599312.517315:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.517327:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599312.517376:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599312.517378:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b37f896800 10000000:01000000:0.0:1787599312.517381:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b37f896800 10000000:01000000:0.0:1787599312.517386:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599312.517392:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37f896800 from 1 10000000:01000000:0.0:1787599312.517394:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599312.517443:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.517451:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.517461:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.517490:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884544:0@lo:101: 00000100:00100000:0.0:1787599312.517549:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.517585:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.517903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884544 00000100:00100000:2.0:1787599312.517912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884544 00000100:00100000:2.0:1787599312.517950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787599312.517960:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9513:x1874433577884544:12345-0@lo:101: 00010000:00010000:2.0:1787599312.517976:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599312.517992:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf1a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.518014:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.518024:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599312.518032:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7a00, rc 0) 00000100:00100000:2.0:1787599312.518079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884544:12345-0@lo:101: Request processed in 120us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.518086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787599312.518232:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884544:0@lo:101: 00010000:00010000:0.0:1787599312.518249:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.518259:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.518347:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884672:0@lo:501: 00000100:00100000:0.0:1787599312.518376:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.518513:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.518553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884672 00000100:00100000:2.0:1787599312.518558:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884672 00000100:00100000:2.0:1787599312.518594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787599312.518602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884672:12345-0@lo:501: 00000100:00100000:2.0:1787599312.519007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884672:12345-0@lo:501: Request processed in 404us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.519015:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787599312.521771:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884672:0@lo:501: 00000100:00100000:0.0:1787599312.521944:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884800:0@lo:503: 00000100:00100000:0.0:1787599312.522011:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.522054:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787599312.522133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884800 00000100:00100000:3.0:1787599312.522140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884800 00000100:00100000:3.0:1787599312.522190:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787599312.522199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884800:12345-0@lo:503: 00000100:00100000:3.0:1787599312.522319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884800:12345-0@lo:503: Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.522327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787599312.522540:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884800:0@lo:503: 00000040:00080000:0.0:1787599312.523061:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599312.523173:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884928:0@lo:502: 00000100:00100000:0.0:1787599312.523231:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.523276:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.523347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577884928 00000100:00100000:2.0:1787599312.523361:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577884928 00000100:00100000:2.0:1787599312.523391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787599312.523398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884928:12345-0@lo:502: 00000100:00100000:2.0:1787599312.523517:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577884928:12345-0@lo:502: Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.523524:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787599312.523716:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577884928:0@lo:502: 00000040:00080000:0.0:1787599312.524053:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787599312.524080:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787599312.524094:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787599312.524105:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787599312.524118:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787599312.524131:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787599312.524144:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787599312.524157:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787599312.524171:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787599312.524183:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787599312.524195:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787599312.524208:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787599312.524221:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787599312.524233:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787599312.524261:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787599312.524276:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787599312.524288:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787599312.524300:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787599312.524311:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787599312.524324:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787599312.524338:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787599312.524351:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787599312.524363:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787599312.524376:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787599312.524387:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787599312.524399:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787599312.524561:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787599312.524585:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787599312.524598:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787599312.524611:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787599312.524635:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787599312.524724:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787599312.524740:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787599312.524751:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787599312.524763:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787599312.524777:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787599312.525514:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1787599312.525540:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787599312.525553:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1787599312.525565:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1787599312.525578:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1787599312.525590:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1787599312.525603:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1787599312.525615:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1787599312.525627:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1787599312.525637:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1787599312.525757:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577885056:0@lo:502: 00000100:00100000:0.0:1787599312.526021:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.526096:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599312.529185:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885056 00000100:00100000:2.0:1787599312.529198:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885056 00000100:00100000:2.0:1787599312.529288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787599312.529300:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577885056:12345-0@lo:502: 00000100:00100000:2.0:1787599312.529505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577885056:12345-0@lo:502: Request processed in 198us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.529514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787599312.529609:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577885056:0@lo:502: 00000040:00080000:0.0:1787599312.529697:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787599312.529712:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787599312.534040:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787599312.534060:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96b37f89b370) 00000020:00000080:3.0:1787599312.534084:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787599312.534163:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f896800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599312.534168:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f896800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599312.534170:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f896800 3 00010000:00080000:3.0:1787599312.534223:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2430b8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599312.537398:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787599312.537761:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787599312.538053:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599312.538071:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d2988b0929cf1b7 00000100:00080000:3.0:1787599312.538082:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599312.538088:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b2430b8800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599312.538127:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2419c0a80 x1874433577885184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599312.538151:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787599312.538389:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577885696:0@lo:400: 00000100:00100000:2.0:1787599312.538470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538516:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787599312.538523:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577885312:0@lo:400: 00000100:00100000:2.0:1787599312.538546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577885824:0@lo:400: 00000100:00100000:2.0:1787599312.538584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538610:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577885440:0@lo:400: 00000100:00100000:2.0:1787599312.538633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538656:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577885952:0@lo:400: 00000100:00100000:2.0:1787599312.538680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538701:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599312.538707:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577885568:0@lo:400: 00000100:00100000:2.0:1787599312.538743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538763:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577886080:0@lo:400: 00000100:00100000:2.0:1787599312.538785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.538850:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885696 00000100:00100000:2.0:1787599312.538857:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885696 00000100:00100000:2.0:1787599312.538904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885312 00000100:00100000:2.0:1787599312.538907:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885312 00000100:00100000:2.0:1787599312.538919:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885824 00000100:00100000:2.0:1787599312.538921:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885824 00000100:00100000:2.0:1787599312.538932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885440 00000100:00100000:2.0:1787599312.538934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885440 00000100:00100000:2.0:1787599312.538948:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599312.538957:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577885696:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539011:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577885696:12345-0@lo:400: Request processed in 54us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599312.539033:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599312.539039:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577885312:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539065:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577885312:12345-0@lo:400: Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539070:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599312.539080:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599312.539085:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577885824:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577885824:12345-0@lo:400: Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599312.539123:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599312.539129:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577885440:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539164:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577885440:12345-0@lo:400: Request processed in 36us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539169:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599312.539197:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885952 00000100:00100000:2.0:1787599312.539201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885952 00000100:00100000:2.0:1787599312.539224:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886080 00000100:00100000:2.0:1787599312.539227:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886080 00000100:00100000:2.0:1787599312.539246:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599312.539252:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577885952:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539280:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577885952:12345-0@lo:400: Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539285:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599312.539295:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599312.539300:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577886080:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539325:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577886080:12345-0@lo:400: Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539330:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599312.539345:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885568 00000100:00100000:2.0:1787599312.539348:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885568 00000100:00100000:2.0:1787599312.539372:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599312.539378:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577885568:12345-0@lo:400: 00000100:00100000:2.0:1787599312.539408:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577885568:12345-0@lo:400: Request processed in 31us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.539414:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787599312.539431:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599312.539435:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599312.539437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599312.539470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577885568:0@lo:400: 00010000:00080000:2.0:1787599312.539502:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241093800 x1874433577886080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577886080:0@lo:400: 00010000:00080000:2.0:1787599312.539523:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241090700 x1874433577885440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577885440:0@lo:400: 00010000:00080000:2.0:1787599312.539540:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241093480 x1874433577885952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539549:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577885952:0@lo:400: 00010000:00080000:2.0:1787599312.539582:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241091f80 x1874433577885312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539590:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577885312:0@lo:400: 00010000:00080000:2.0:1787599312.539599:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241092d80 x1874433577885824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539606:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577885824:0@lo:400: 00010000:00080000:2.0:1787599312.539614:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b241091180 x1874433577885696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.539620:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577885696:0@lo:400: 00000100:00100000:1.0:1787599312.539909:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433577885184:0@lo:38: 00000100:00100000:1.0:1787599312.539950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787599312.540160:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787599312.540184:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff96b37f89cd28) 00000020:00000080:3.0:1787599312.540205:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1787599312.540291:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f896800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599312.540295:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f896800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599312.540298:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f896800 3 00010000:00080000:3.0:1787599312.540326:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2430b9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.101@tcp at head 00000100:00080000:1.0:1787599312.540558:0:9530:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff96b242ddf100 x1874433577886208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599312.540568:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3706b2240 going to sleep for 0 seconds 00000100:00100000:2.0:1787599312.540715:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577885184 00000100:00100000:2.0:1787599312.540721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577885184 00000100:00100000:2.0:1787599312.540747:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599312.540754:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433577885184:12345-0@lo:38: 00010000:00080000:2.0:1787599312.540774:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1787599312.541105:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d2988b0929cf1c5 00000004:00100000:2.0:1787599312.541120:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787599312.541150:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96b2419cf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599312.541213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874433577885184:12345-0@lo:38: Request processed in 458us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.541220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787599312.541257:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c0a80 x1874433577885184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.541266:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599312.541273:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787599312.541281:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787599312.541284:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787599312.541287:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787599312.541292:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000061ee223c): req@ffff96b242ddf100 x1874433577886208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.541307:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433577885184:0@lo:38: 00000100:00100000:2.0:1787599312.541358:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599312.541385:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886208 00000100:00100000:2.0:1787599312.541389:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886208 00000100:00100000:2.0:1787599312.541438:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599312.541445:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874433577886208:12345-0@lo:901: 00000100:00100000:2.0:1787599312.541547:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874433577886208:12345-0@lo:901: Request processed in 101us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599312.541553:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787599312.541573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599312.541592:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b242ddf100 x1874433577886208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787599328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.541613:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1874433577886208:0@lo:901: 00010000:00010000:3.0:1787599312.546381:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787599312.546617:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787599312.550338:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599312.550359:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5d2988b0929cf1cc 00000100:00080000:3.0:1787599312.550372:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599312.550380:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96b2430b9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599312.550926:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2419c3800 x1874433577886336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599312.550988:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433577886336:0@lo:38: 00000100:00100000:2.0:1787599312.551074:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599312.551140:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787599312.554555:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886336 00000100:00100000:3.0:1787599312.554569:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886336 00000100:00100000:3.0:1787599312.554620:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599312.554628:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433577886336:12345-0@lo:38: 00010000:00080000:3.0:1787599312.554668:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1787599312.554707:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5d2988b0929cf1d3 00000004:00100000:3.0:1787599312.554723:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599312.554756:0:6520:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599312.560973:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874433577886336:12345-0@lo:38: Request processed in 6334us (9888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.560987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1787599312.561411:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1787599312.561591:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1787599312.561622:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599312.561665:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.561676:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599312.561722:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599312.561723:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599312.561725:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599312.561726:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599312.561727:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599312.561728:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599312.561730:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599312.561732:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599312.561733:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599312.561735:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599312.561736:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599312.561740:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787599312.561742:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599312.561744:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599312.561745:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599312.561746:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599312.561747:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599312.561748:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599312.561749:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599312.561750:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599312.561751:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599312.561752:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599312.561753:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599312.561776:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787599312.561973:0:9513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577886464:0@lo:253: 00000100:00100000:3.0:1787599312.562036:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599312.562072:0:9513:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599312.562147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886464 00000100:00100000:1.0:1787599312.562154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886464 00000100:00100000:1.0:1787599312.562202:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787599312.562210:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577886464:12345-0@lo:253: 20000000:01000000:1.0:1787599312.562234:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787599312.562246:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787599312.563486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2419c3800 x1874433577886336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599312.563500:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599312.563511:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787599312.563520:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787599312.563525:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787599312.563529:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787599312.563535:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433577886336:0@lo:38: 20000000:01000000:3.0:1787599312.569821:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787599312.569839:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787599312.570145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9513:x1874433577886464:12345-0@lo:253: Request processed in 7932us (8104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.570163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787599312.570247:0:9513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9513:1874433577886464:0@lo:253: 10000000:01000000:2.0:1787599312.570258:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787599312.570260:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599312.570262:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599312.570263:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599312.570264:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599312.570265:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599312.570265:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599312.570267:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599312.570268:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599312.570269:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599312.570270:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599312.570271:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787599312.570285:0:9513:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787599312.572836:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787599312.572959:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787599312.573079:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787599312.573181:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787599312.573306:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 20000000:01000000:0.0:1787599312.573921:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599312.573926:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599312.573944:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.573959:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.573971:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.573976:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.574008:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.574019:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.574030:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577886592:0@lo:104: 00000100:00100000:0.0:1787599312.574079:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599312.574127:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599312.574133:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599312.574138:0:6536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577886720:0@lo:104: 00000100:00100000:0.0:1787599312.574151:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599312.574167:0:6536:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370672cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599312.574216:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886592 00000100:00100000:3.0:1787599312.574222:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886592 00000100:00100000:3.0:1787599312.574261:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886720 00000100:00100000:3.0:1787599312.574263:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886720 00000100:00100000:3.0:1787599312.574272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599312.574278:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577886592:12345-0@lo:104: 00010000:00010000:3.0:1787599312.574288:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574332:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599312.574337:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:6536:x1874433577886592:12345-0@lo:104: Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.574343:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599312.574358:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599312.574365:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577886720:12345-0@lo:104: 00010000:00010000:3.0:1787599312.574372:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574416:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787599312.574420:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:6536:x1874433577886720:12345-0@lo:104: Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.574425:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787599312.574438:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599312.574442:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574447:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599312.574455:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574463:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599312.574470:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599312.574485:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599312.574512:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574519:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599312.574533:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574538:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497c00/0x5d2988b0929cf10f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf116 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574547:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599312.574549:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574552:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599312.574554:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574558:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599312.574569:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599312.574573:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599312.574583:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574588:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599312.574593:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574599:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf0d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574609:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599312.574611:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599312.574613:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599312.574619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599312.574635:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577886976:0@lo:103: 00000100:00100000:3.0:1787599312.574668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599312.574683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599312.574687:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577886848:0@lo:103: 00000100:00100000:3.0:1787599312.574698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599312.574716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886976 00000100:00100000:3.0:1787599312.574719:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886976 00010000:00010000:3.0:1787599312.574731:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 17 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599312.574744:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577886848 00000100:00100000:3.0:1787599312.574750:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577886848 00010000:00010000:3.0:1787599312.574757:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 18 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599312.574765:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599312.574769:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3648:x1874433577886976:12345-0@lo:103: 00010000:00010000:3.0:1787599312.574776:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599312.574779:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 18 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574894:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 18 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574906:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599312.574928:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3648:x1874433577886976:12345-0@lo:103: Request processed in 158us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.574932:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599312.574941:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599312.574945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3648:x1874433577886848:12345-0@lo:103: 00010000:00010000:3.0:1787599312.574950:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599312.574953:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 17 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574958:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 17 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574965:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574970:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599312.574984:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006699858s 00010000:00010000:3.0:1787599312.574987:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574992:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574995:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.574999:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575002:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599312.575004:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575009:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575014:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575020:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599312.575034:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3648:x1874433577886848:12345-0@lo:103: Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599312.575038:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599312.575067:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577886848:0@lo:103: 00000100:00100000:3.0:1787599312.575072:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577886976:0@lo:103: 00010000:00010000:3.0:1787599312.575099:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031000/0x5d2988b0929cf116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf10f expref: 16 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599312.575107:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577886592:0@lo:104: 00010000:00010000:3.0:1787599312.575112:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf0c9 expref: 15 pid: 6514 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599312.575117:0:6536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874433577886720:0@lo:104: 00010000:00010000:3.0:1787599312.575126:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575132:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575135:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599312.575139:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324c00/0x5d2988b0929cf1da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787599312.576954:0:9513:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787599312.578557:0:9513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787599312.592671:0:9513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787599312.592681:0:9513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787599312.592721:0:9513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599312.592764:0:9513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599312.592782:0:9513:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787599312.592837:0:9513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787599312.597051:0:9513:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599312.598581:0:9513:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787599313.126026:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787599313.608095:0:9585:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599313.608303:0:9585:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787599313.957095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577887104:0@lo:41: 00000100:00100000:1.0:1787599313.957167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599313.958304:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887104 00000100:00100000:3.0:1787599313.958314:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887104 00000100:00100000:3.0:1787599313.958379:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599313.958392:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577887104:12345-0@lo:41: 00000004:00000024:3.0:1787599313.958432:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787599313.959843:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577887104:12345-0@lo:41: Request processed in 1446us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599313.959867:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599313.964085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577887104:0@lo:41: 00010000:00010000:3.0:1787599314.155137:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599315.176488:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599316.004932:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577887232:0@lo:13: 00000100:00100000:2.0:1787599316.005003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599316.005081:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887232 00000100:00100000:2.0:1787599316.005088:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887232 00000100:00100000:2.0:1787599316.005134:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599316.005143:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577887232:12345-0@lo:13: 00002000:00000024:2.0:1787599316.005182:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599316.005223:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577887232:12345-0@lo:13: Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599316.005230:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787599316.005248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599316.005273:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b241091180 x1874433577887232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599316.005290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577887232:0@lo:13: 00000100:00100000:0.0:1787599316.005443:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599316.005479:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577887360:0@lo:13: 00000100:00100000:0.0:1787599316.005507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599316.005620:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887360 00000100:00100000:2.0:1787599316.005625:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887360 00000100:00100000:2.0:1787599316.005669:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599316.005677:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577887360:12345-0@lo:13: 00002000:00000024:2.0:1787599316.005687:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599316.005719:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577887360:12345-0@lo:13: Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599316.005724:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787599316.005748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b343045500 x1874433577887360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599316.005761:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577887360:0@lo:13: 00000100:00080000:0.0:1787599316.006278:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599316.198571:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599317.224431:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599317.541584:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599317.541618:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577887488:0@lo:41: 00000100:00100000:0.0:1787599317.541696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599317.541767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887488 00000100:00100000:0.0:1787599317.541775:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887488 00000100:00100000:0.0:1787599317.541850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787599317.541861:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577887488:12345-0@lo:41: 00000004:00000024:0.0:1787599317.541909:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787599317.541965:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577887488:12345-0@lo:41: Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599317.541972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787599317.542017:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577887488:0@lo:41: 00000100:00100000:0.0:1787599318.053108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577887872:0@lo:400: 00000100:00100000:0.0:1787599318.053183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599318.053244:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577888384:0@lo:400: 00000100:00100000:0.0:1787599318.053268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599318.053297:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599318.053302:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577888000:0@lo:400: 00000100:00100000:0.0:1787599318.053324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053456:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577887616:0@lo:400: 00000100:00100000:1.0:1787599318.053490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053515:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577888128:0@lo:400: 00000100:00100000:1.0:1787599318.053538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053555:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577888640:0@lo:400: 00000100:00100000:1.0:1787599318.053573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053590:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599318.053595:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577887744:0@lo:400: 00000100:00100000:1.0:1787599318.053616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577888256:0@lo:400: 00000100:00100000:1.0:1787599318.053644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053654:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577888768:0@lo:400: 00000100:00100000:1.0:1787599318.053676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599318.053700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887616 00000100:00100000:1.0:1787599318.053707:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887616 00000100:00100000:1.0:1787599318.053766:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787599318.053775:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3645:x1874433577887616:12345-0@lo:400: 00000100:00100000:1.0:1787599318.053845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3645:x1874433577887616:12345-0@lo:400: Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.053853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787599318.053887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887872 00000100:00100000:1.0:1787599318.053891:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887872 00000100:00100000:1.0:1787599318.053909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888128 00000100:00100000:1.0:1787599318.053912:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888128 00000100:00100000:1.0:1787599318.053932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888640 00000100:00100000:1.0:1787599318.053935:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888640 00000100:00100000:1.0:1787599318.053944:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577887744 00000100:00100000:1.0:1787599318.053947:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577887744 00000100:00100000:1.0:1787599318.053956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888256 00000100:00100000:1.0:1787599318.053958:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888256 00000100:00100000:1.0:1787599318.053970:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888768 00000100:00100000:1.0:1787599318.053972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888768 00000100:00100000:1.0:1787599318.053984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599318.053990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577887872:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054023:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577887872:12345-0@lo:400: Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599318.054042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599318.054047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577888128:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054074:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577888128:12345-0@lo:400: Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599318.054090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787599318.054096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577888640:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577888640:12345-0@lo:400: Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787599318.054145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787599318.054150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577887744:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054173:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577887744:12345-0@lo:400: Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787599318.054189:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599318.054194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577888256:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054218:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577888256:12345-0@lo:400: Request processed in 24us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054223:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599318.054233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787599318.054239:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577888768:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054264:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577888768:12345-0@lo:400: Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787599318.054311:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b343045500 x1874433577887744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.054326:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577887744:0@lo:400: 00010000:00080000:1.0:1787599318.054337:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433577888256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.054418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577888256:0@lo:400: 00010000:00080000:1.0:1787599318.054448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0a80 x1874433577888768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.054457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577888768:0@lo:400: 00000100:00100000:1.0:1787599318.054467:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577887616:0@lo:400: 00010000:00080000:1.0:1787599318.054476:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b343045c00 x1874433577888128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.054483:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577888128:0@lo:400: 00010000:00080000:1.0:1787599318.054491:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e3800 x1874433577888640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.054499:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577888640:0@lo:400: 00000100:00100000:1.0:1787599318.054557:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888384 00000100:00100000:1.0:1787599318.054563:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888384 00000100:00100000:1.0:1787599318.054592:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599318.054599:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577888384:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054633:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577888384:12345-0@lo:400: Request processed in 34us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054638:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599318.054672:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888000 00000100:00100000:1.0:1787599318.054676:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888000 00000100:00100000:1.0:1787599318.054699:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599318.054705:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577888000:12345-0@lo:400: 00000100:00100000:1.0:1787599318.054738:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577888000:12345-0@lo:400: Request processed in 33us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599318.054744:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787599318.054773:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599318.054778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599318.054780:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599318.054959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577888000:0@lo:400: 00000100:00100000:1.0:1787599318.054968:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577888512:0@lo:400: 00000100:00100000:1.0:1787599318.054995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787599318.055067:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b343045180 x1874433577887872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.055077:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577887872:0@lo:400: 00010000:00080000:1.0:1787599318.055087:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2d80 x1874433577888384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.055094:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577888384:0@lo:400: 00000100:00100000:0.0:1787599318.055297:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888512 00000100:00100000:0.0:1787599318.055302:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888512 00000100:00100000:0.0:1787599318.055335:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787599318.055551:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599318.055599:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577888512:12345-0@lo:400: 00000100:00100000:0.0:1787599318.055647:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577888512:12345-0@lo:400: Request processed in 52us (651us total) trans 0 rc 0/0 00010000:00080000:1.0:1787599318.055712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e3480 x1874433577888512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599318.055722:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577888512:0@lo:400: 00000100:00100000:0.0:1787599318.055862:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787599318.245045:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599318.430179:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787599319.079964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599319.080255:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577888896:0@lo:41: 00000100:00100000:3.0:1787599319.080331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599319.080456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577888896 00000100:00100000:0.0:1787599319.080477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577888896 00000100:00100000:3.0:1787599319.080541:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787599319.080553:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577888896:12345-0@lo:41: 00000004:00000024:3.0:1787599319.080586:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787599319.080644:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577888896:12345-0@lo:41: Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599319.080652:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599319.080752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577888896:0@lo:41: 00010000:00010000:3.0:1787599319.272521:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787599319.375997:0:9927:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599319.378012:0:9927:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599320.301331:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599321.125165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599321.125192:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577889152:0@lo:13: 00000100:00100000:0.0:1787599321.125270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.125429:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599321.125442:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577889024:0@lo:13: 00000100:00100000:1.0:1787599321.125476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.125624:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889152 00000100:00100000:0.0:1787599321.125632:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889152 00000100:00100000:0.0:1787599321.125679:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889024 00000100:00100000:0.0:1787599321.125682:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889024 00000100:00100000:0.0:1787599321.125699:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599321.125707:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577889152:12345-0@lo:13: 00002000:00000024:0.0:1787599321.125735:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599321.125779:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577889152:12345-0@lo:13: Request processed in 72us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.125786:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599321.125836:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599321.125843:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577889024:12345-0@lo:13: 00002000:00000024:0.0:1787599321.125852:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599321.125879:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577889024:12345-0@lo:13: Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.125884:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787599321.125929:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0e00 x1874433577889152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.125946:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577889152:0@lo:13: 00000100:00080000:1.0:1787599321.126074:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599321.126094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b241091180 x1874433577889024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.126106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577889024:0@lo:13: 10000000:01000000:0.0:1787599321.126338:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787599321.126343:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3778e6800 from 39 10000000:01000000:0.0:1787599321.126346:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599321.126389:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.126410:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.126421:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599321.126437:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889280:0@lo:101: 00000100:00100000:0.0:1787599321.126470:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.126569:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.126618:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889280 00000100:00100000:3.0:1787599321.126623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889280 00000100:00100000:3.0:1787599321.126661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599321.126667:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577889280:12345-0@lo:101: 00010000:00010000:3.0:1787599321.126676:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599321.126688:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf1e1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.126708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.126717:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.126737:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3821d1200, rc 0) 00000100:00100000:3.0:1787599321.126773:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889280:12345-0@lo:101: Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.126779:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787599321.126947:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889280:0@lo:101: 00010000:00010000:0.0:1787599321.126962:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.126972:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599321.127026:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889408:0@lo:501: 00000100:00100000:0.0:1787599321.127052:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.127082:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599321.127132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889408 00000100:00100000:1.0:1787599321.127143:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889408 00000100:00100000:1.0:1787599321.127174:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599321.127181:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889408:12345-0@lo:501: 00000100:00100000:1.0:1787599321.127295:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889408:12345-0@lo:501: Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.127302:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787599321.127412:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889408:0@lo:501: 00000100:00100000:0.0:1787599321.127439:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889536:0@lo:503: 00000100:00100000:0.0:1787599321.127476:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.127698:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.127748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889536 00000100:00100000:3.0:1787599321.127752:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889536 00000100:00100000:3.0:1787599321.129413:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787599321.129439:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889536:12345-0@lo:503: 00000100:00100000:3.0:1787599321.129622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889536:12345-0@lo:503: Request processed in 195us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.129629:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787599321.129732:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889536:0@lo:503: 00000100:00100000:0.0:1787599321.130041:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9979:1874433577889664:0@lo:502: 00000100:00100000:0.0:1787599321.130092:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.137121:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.144627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889664 00000100:00100000:2.0:1787599321.144644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889664 00000100:00100000:2.0:1787599321.144720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599321.144730:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9979:x1874433577889664:12345-0@lo:502: 00000100:00100000:2.0:1787599321.144936:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9979:x1874433577889664:12345-0@lo:502: Request processed in 206us (14843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.144944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787599321.145145:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9979:1874433577889664:0@lo:502: 00000100:00100000:0.0:1787599321.145217:0:9979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9979:1874433577889792:0@lo:502: 00000100:00100000:0.0:1787599321.145260:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.145296:0:9979:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.145347:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889792 00000100:00100000:2.0:1787599321.145351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889792 00000100:00100000:2.0:1787599321.145368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599321.145374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9979:x1874433577889792:12345-0@lo:502: 00000100:00100000:2.0:1787599321.145452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:9979:x1874433577889792:12345-0@lo:502: Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.145458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787599321.145528:0:9979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9979:1874433577889792:0@lo:502: 00000040:00080000:0.0:1787599321.145547:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787599321.145721:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787599321.145749:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599321.145759:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.145769:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599321.145782:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787599321.145785:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787599321.145788:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599321.145853:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.145861:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.145870:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599321.145882:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889920:0@lo:101: 00000100:00100000:2.0:1787599321.145911:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.145926:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.146008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577889920 00000100:00100000:0.0:1787599321.146014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577889920 00000100:00100000:0.0:1787599321.146036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787599321.146043:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577889920:12345-0@lo:101: 00010000:00010000:0.0:1787599321.146052:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599321.146065:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf1ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.146084:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.146093:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.146102:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324000, rc 0) 00000100:00100000:0.0:1787599321.146129:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577889920:12345-0@lo:101: Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.146135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599321.146313:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577889920:0@lo:101: 00010000:00010000:2.0:1787599321.146325:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.146334:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599321.146380:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890048:0@lo:501: 00000100:00100000:2.0:1787599321.146426:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.146454:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599321.146536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890048 00000100:00100000:1.0:1787599321.146541:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890048 00000100:00100000:1.0:1787599321.146577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787599321.146585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577890048:12345-0@lo:501: 00000100:00100000:1.0:1787599321.146704:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577890048:12345-0@lo:501: Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.146711:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599321.147327:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890048:0@lo:501: 00000100:00100000:2.0:1787599321.147362:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890176:0@lo:503: 00000100:00100000:2.0:1787599321.147422:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.147446:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599321.147730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890176 00000100:00100000:1.0:1787599321.147737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890176 00000100:00100000:1.0:1787599321.147777:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787599321.147786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577890176:12345-0@lo:503: 00000100:00100000:1.0:1787599321.147925:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577890176:12345-0@lo:503: Request processed in 140us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.147933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787599321.149136:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890176:0@lo:503: 00000100:00100000:1.0:1787599321.157846:0:9980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9980:1874433577890304:0@lo:502: 00000100:00100000:1.0:1787599321.157973:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.158018:0:9980:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.158110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890304 00000100:00100000:0.0:1787599321.158124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890304 00000100:00100000:0.0:1787599321.158166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599321.158176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9980:x1874433577890304:12345-0@lo:502: 00000100:00100000:0.0:1787599321.158315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9980:x1874433577890304:12345-0@lo:502: Request processed in 140us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.158323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599321.158446:0:9980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9980:1874433577890304:0@lo:502: 00000020:01000000:1.0:1787599321.158473:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599321.158483:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599321.158486:0:9980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599321.158497:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599321.158499:0:9980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787599321.158516:0:9980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9980:1874433577890432:0@lo:502: 00000100:00100000:1.0:1787599321.158548:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.160514:0:9980:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.161218:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890432 00000100:00100000:0.0:1787599321.161229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890432 00000100:00100000:0.0:1787599321.161379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787599321.161390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9980:x1874433577890432:12345-0@lo:502: 00000100:00100000:0.0:1787599321.161561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:9980:x1874433577890432:12345-0@lo:502: Request processed in 173us (3011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.161570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787599321.161657:0:9980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9980:1874433577890432:0@lo:502: 00000020:01000000:1.0:1787599321.161688:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599321.161695:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599321.161697:0:9980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787599321.161702:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787599321.161920:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787599321.161940:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787599321.161949:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.161960:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599321.161970:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599321.161972:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3812cf000 from 39 10000000:01000000:1.0:1787599321.161975:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599321.162020:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.162029:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.162038:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599321.162056:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890560:0@lo:101: 00000100:00100000:1.0:1787599321.162101:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.163426:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.163540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890560 00000100:00100000:2.0:1787599321.163549:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890560 00000100:00100000:2.0:1787599321.163592:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787599321.163601:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577890560:12345-0@lo:101: 00010000:00010000:2.0:1787599321.163615:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599321.163645:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf1fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.163670:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.163681:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.163690:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7e00, rc 0) 00000100:00100000:2.0:1787599321.163750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577890560:12345-0@lo:101: Request processed in 150us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.163758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787599321.164414:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890560:0@lo:101: 00010000:00010000:1.0:1787599321.164432:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.164443:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599321.164510:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890688:0@lo:501: 00000100:00100000:1.0:1787599321.164549:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.164571:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.164622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890688 00000100:00100000:2.0:1787599321.164627:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890688 00000100:00100000:2.0:1787599321.164676:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787599321.164683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577890688:12345-0@lo:501: 00000100:00100000:2.0:1787599321.164856:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577890688:12345-0@lo:501: Request processed in 173us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.164862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787599321.165242:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890688:0@lo:501: 00000100:00100000:1.0:1787599321.165271:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890816:0@lo:503: 00000100:00100000:1.0:1787599321.165309:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.165482:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.165531:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890816 00000100:00100000:2.0:1787599321.165536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890816 00000100:00100000:2.0:1787599321.165596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787599321.165604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577890816:12345-0@lo:503: 00000100:00100000:2.0:1787599321.165694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577890816:12345-0@lo:503: Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.165701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787599321.165764:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577890816:0@lo:503: 00000100:00100000:1.0:1787599321.166520:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9981:1874433577890944:0@lo:502: 00000100:00100000:1.0:1787599321.166564:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.166625:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.166658:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577890944 00000100:00100000:0.0:1787599321.166663:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577890944 00000100:00100000:0.0:1787599321.166728:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787599321.166737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:9981:x1874433577890944:12345-0@lo:502: 00000100:00100000:0.0:1787599321.166874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:9981:x1874433577890944:12345-0@lo:502: Request processed in 138us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.166882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787599321.166958:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9981:1874433577890944:0@lo:502: 00000100:00100000:1.0:1787599321.167011:0:9981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9981:1874433577891072:0@lo:502: 00000100:00100000:1.0:1787599321.167045:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.167254:0:9981:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.167315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891072 00000100:00100000:2.0:1787599321.167320:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891072 00000100:00100000:2.0:1787599321.167345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787599321.167352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:9981:x1874433577891072:12345-0@lo:502: 00000100:00100000:2.0:1787599321.167505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:9981:x1874433577891072:12345-0@lo:502: Request processed in 152us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.167512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787599321.167601:0:9981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9981:1874433577891072:0@lo:502: 00000040:00080000:1.0:1787599321.167628:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787599321.167924:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787599321.167944:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599321.167953:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.167965:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599321.168252:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599321.168256:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3812cf000 from 6 10000000:01000000:0.0:1787599321.168259:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599321.168290:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.168298:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.168319:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599321.168335:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891200:0@lo:101: 00000100:00100000:0.0:1787599321.168372:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.174011:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.178604:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891200 00000100:00100000:3.0:1787599321.178624:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891200 00000100:00100000:2.0:1787599321.181310:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787599321.181338:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577891200:12345-0@lo:101: 00010000:00010000:2.0:1787599321.181357:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599321.181377:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7c00/0x5d2988b0929cf212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf20b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.181416:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7c00/0x5d2988b0929cf212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf20b expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.181428:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7c00/0x5d2988b0929cf212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf20b expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.181438:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7c00, rc 0) 00000100:00100000:2.0:1787599321.181525:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577891200:12345-0@lo:101: Request processed in 190us (13152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.181532:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787599321.181615:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891200:0@lo:101: 00010000:00010000:1.0:1787599321.181635:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.181645:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599321.181749:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891328:0@lo:256: 00000100:00100000:1.0:1787599321.181823:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.185340:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.188718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891328 00000100:00100000:0.0:1787599321.188736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891328 00000100:00100000:0.0:1787599321.188824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787599321.188835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577891328:12345-0@lo:256: 20000000:01000000:0.0:1787599321.188863:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599321.188890:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599321.188893:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787599321.189470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577891328:12345-0@lo:256: Request processed in 634us (7676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.189478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787599321.189562:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891328:0@lo:256: 10000000:01000000:1.0:1787599321.189620:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599321.189631:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.189642:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599321.189652:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787599321.189654:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787599321.189657:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787599321.189687:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.189695:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.189714:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599321.189733:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891456:0@lo:101: 00000100:00100000:1.0:1787599321.189766:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.189829:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.191908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891456 00000100:00100000:2.0:1787599321.191922:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891456 00000100:00100000:2.0:1787599321.191983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787599321.191993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577891456:12345-0@lo:101: 00010000:00010000:2.0:1787599321.192023:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599321.192043:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf219 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.192069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.192081:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.192090:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6600, rc 0) 00000100:00100000:2.0:1787599321.192182:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577891456:12345-0@lo:101: Request processed in 190us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.192188:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787599321.192469:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891456:0@lo:101: 00010000:00010000:1.0:1787599321.192487:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599321.192497:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599321.192566:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891584:0@lo:501: 00000100:00100000:1.0:1787599321.192603:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.192641:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.192712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891584 00000100:00100000:0.0:1787599321.192718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891584 00000100:00100000:0.0:1787599321.192744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599321.192751:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577891584:12345-0@lo:501: 00000100:00100000:0.0:1787599321.192923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577891584:12345-0@lo:501: Request processed in 171us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.192930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787599321.193026:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891584:0@lo:501: 00000100:00100000:1.0:1787599321.193052:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891712:0@lo:503: 00000100:00100000:1.0:1787599321.193093:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.193111:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.193212:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891712 00000100:00100000:0.0:1787599321.193217:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891712 00000100:00100000:0.0:1787599321.193237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599321.193243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577891712:12345-0@lo:503: 00000100:00100000:0.0:1787599321.193333:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577891712:12345-0@lo:503: Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.193340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787599321.193420:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577891712:0@lo:503: 00000100:00100000:1.0:1787599321.193874:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9982:1874433577891840:0@lo:502: 00000100:00100000:1.0:1787599321.193912:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.193937:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.193987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891840 00000100:00100000:2.0:1787599321.193992:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891840 00000100:00100000:2.0:1787599321.194035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787599321.194042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:9982:x1874433577891840:12345-0@lo:502: 00000100:00100000:2.0:1787599321.194127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:9982:x1874433577891840:12345-0@lo:502: Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.194134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787599321.194267:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9982:1874433577891840:0@lo:502: 00000020:01000000:1.0:1787599321.194298:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599321.194306:0:9982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787599321.194312:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599321.194314:0:9982:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787599321.194318:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599321.194322:0:9982:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1787599321.194345:0:9982:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787599321.194349:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599321.194363:0:9982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff96b37077cd28) 00000020:00000080:1.0:1787599321.194387:0:9982:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787599321.194392:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599321.194505:0:9982:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787599321.194512:0:9982:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787599321.194521:0:9982:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929cf22e 00010000:00080000:1.0:1787599321.194551:0:9982:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b243466800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1787599321.194861:0:9982:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787599321.195084:0:9982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787599321.195096:0:9982:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787599321.195258:0:9982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599321.195389:0:9982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599321.195543:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787599321.195638:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787599321.196771:0:9983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599321.196777:0:9983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787599321.197824:0:9982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599321.197836:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599321.197898:0:9982:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787599321.197924:0:9982:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cf235 00000100:00080000:2.0:1787599321.197935:0:9982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599321.197941:0:9982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b243466800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599321.197981:0:9982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b241091f80 x1874433577891968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599321.198584:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577891968:0@lo:8: 00000100:00100000:1.0:1787599321.198665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.198782:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577891968 00000100:00100000:3.0:1787599321.198823:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577891968 00000100:00100000:3.0:1787599321.198858:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599321.198868:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433577891968:12345-0@lo:8: 00010000:00080000:3.0:1787599321.198902:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1787599321.198933:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929cf23c 00002000:00100000:3.0:1787599321.198948:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff96b2430bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787599321.198953:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787599321.198956:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787599321.199085:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787599321.199342:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787599321.199368:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787599321.199690:0:9982:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787599321.199784:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599321.199805:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599321.199807:0:9982:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787599321.199811:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599321.199816:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599321.199817:0:9982:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599321.199820:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599321.199822:0:9982:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787599321.199855:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9982:1874433577892096:0@lo:502: 00000100:00100000:2.0:1787599321.199914:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.199955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892096 00000100:00100000:2.0:1787599321.199961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892096 00000100:00100000:2.0:1787599321.199995:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787599321.200017:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:9982:x1874433577892096:12345-0@lo:502: 00000100:00100000:2.0:1787599321.200118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:9982:x1874433577892096:12345-0@lo:502: Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.200126:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787599321.200173:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345d16900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.200192:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9982:1874433577892096:0@lo:502: 00000020:01000000:2.0:1787599321.200216:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599321.200220:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599321.200222:0:9982:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787599321.200225:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787599321.200277:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787599321.200298:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787599321.200308:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.200318:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599321.200329:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787599321.200331:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3707b1000 from 39 10000000:01000000:2.0:1787599321.200334:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599321.200359:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.200367:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.200388:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599321.200419:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892224:0@lo:101: 00000100:00100000:2.0:1787599321.200448:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.200465:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345d16900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.200602:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433577891968:12345-0@lo:8: Request processed in 1733us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.200616:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599321.200639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892224 00000100:00100000:3.0:1787599321.200643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892224 00000100:00100000:3.0:1787599321.200671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787599321.200678:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577892224:12345-0@lo:101: 00010000:00010000:3.0:1787599321.200687:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599321.200699:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf243 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.200721:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.200732:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.200740:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3821d0a00, rc 0) 00000100:00100000:3.0:1787599321.200770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577892224:12345-0@lo:101: Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.200776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787599321.200826:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241093480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892224:0@lo:101: 00010000:00010000:3.0:1787599321.200839:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.200849:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.200901:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892352:0@lo:501: 00000100:00100000:3.0:1787599321.200928:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.200950:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.200962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892352 00000100:00100000:3.0:1787599321.200966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892352 00000100:00100000:3.0:1787599321.200987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787599321.200993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577892352:12345-0@lo:501: 00000100:00100000:3.0:1787599321.201289:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577892352:12345-0@lo:501: Request processed in 294us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.201295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787599321.201325:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892352:0@lo:501: 00000100:00100000:3.0:1787599321.201349:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892480:0@lo:503: 00000100:00100000:3.0:1787599321.201380:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.201393:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.201415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892480 00000100:00100000:3.0:1787599321.201420:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892480 00000100:00100000:3.0:1787599321.201435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787599321.201440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577892480:12345-0@lo:503: 00000100:00100000:3.0:1787599321.201509:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577892480:12345-0@lo:503: Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.201515:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787599321.201552:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577892480:0@lo:503: 00000100:00100000:3.0:1787599321.203155:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577892864:0@lo:400: 00000100:00100000:3.0:1787599321.203215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.203257:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577893376:0@lo:400: 00000100:00100000:3.0:1787599321.203280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.203303:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787599321.203308:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577892736:0@lo:400: 00000100:00100000:3.0:1787599321.203346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.203412:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577893248:0@lo:400: 00000100:00100000:3.0:1787599321.203437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.208044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892864 00000100:00100000:0.0:1787599321.208060:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892864 00000100:00100000:0.0:1787599321.208111:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893376 00000100:00100000:0.0:1787599321.208115:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893376 00000100:00100000:0.0:1787599321.208152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893248 00000100:00100000:0.0:1787599321.208154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893248 00000100:00100000:0.0:1787599321.208172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599321.208182:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577892864:12345-0@lo:400: 00000100:00100000:0.0:1787599321.208272:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577892864:12345-0@lo:400: Request processed in 91us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.208278:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599321.208293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599321.208300:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577893376:12345-0@lo:400: 00000100:00100000:0.0:1787599321.208327:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577893376:12345-0@lo:400: Request processed in 28us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.208333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599321.208344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599321.208350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577893248:12345-0@lo:400: 00000100:00100000:0.0:1787599321.208374:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577893248:12345-0@lo:400: Request processed in 26us (4937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.208379:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599321.208489:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9985:1874433577893632:0@lo:502: 00000100:00100000:0.0:1787599321.208558:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.208588:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.208813:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577892608:0@lo:400: 00000100:00100000:2.0:1787599321.208847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.208873:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577893120:0@lo:400: 00000100:00100000:2.0:1787599321.208893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.208909:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599321.208916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577892992:0@lo:400: 00000100:00100000:2.0:1787599321.208941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.208961:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577893504:0@lo:400: 00000100:00100000:2.0:1787599321.208980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.209014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892608 00000100:00100000:2.0:1787599321.209019:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892608 00000100:00100000:2.0:1787599321.209037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893120 00000100:00100000:2.0:1787599321.209040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893120 00000100:00100000:2.0:1787599321.209052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893504 00000100:00100000:2.0:1787599321.209055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893504 00000100:00100000:2.0:1787599321.209067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599321.209074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577892608:12345-0@lo:400: 00000100:00100000:2.0:1787599321.209110:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577892608:12345-0@lo:400: Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.209116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599321.209139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787599321.209144:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577893120:12345-0@lo:400: 00000100:00100000:2.0:1787599321.209171:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577893120:12345-0@lo:400: Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.209177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787599321.209188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787599321.209194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577893504:12345-0@lo:400: 00000100:00100000:2.0:1787599321.209219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577893504:12345-0@lo:400: Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.209224:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787599321.209241:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892736 00000100:00100000:2.0:1787599321.209244:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892736 00000100:00100000:2.0:1787599321.209266:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577892992 00000100:00100000:2.0:1787599321.209269:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577892992 00000100:00100000:2.0:1787599321.209281:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599321.209287:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577892736:12345-0@lo:400: 00000100:00100000:2.0:1787599321.209320:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577892736:12345-0@lo:400: Request processed in 32us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.209326:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599321.209336:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599321.209342:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577892992:12345-0@lo:400: 00000100:00100000:2.0:1787599321.209367:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577892992:12345-0@lo:400: Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.209372:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599321.209420:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577892992:0@lo:400: 00010000:00080000:2.0:1787599321.209434:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1c00 x1874433577893504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.209456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577893504:0@lo:400: 00010000:00080000:2.0:1787599321.209468:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1880 x1874433577892608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.209477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577892608:0@lo:400: 00010000:00080000:2.0:1787599321.209485:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1500 x1874433577893120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.209492:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577893120:0@lo:400: 00000100:00080000:3.0:1787599321.209786:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599321.209822:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599321.209835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893632 00000100:00100000:3.0:1787599321.209839:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893632 00000100:00100000:3.0:1787599321.209875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787599321.209883:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:9985:x1874433577893632:12345-0@lo:502: 00000100:00100000:3.0:1787599321.210009:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:9985:x1874433577893632:12345-0@lo:502: Request processed in 116us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.210016:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787599321.210067:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577892736:0@lo:400: 00010000:00080000:3.0:1787599321.210079:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0000 x1874433577893248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599321.210088:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577893248:0@lo:400: 00010000:00080000:3.0:1787599321.210099:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2a00 x1874433577892864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599321.210108:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577892864:0@lo:400: 00010000:00080000:3.0:1787599321.210118:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0700 x1874433577893376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599321.210125:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577893376:0@lo:400: 00000100:00100000:0.0:1787599321.210255:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9985:1874433577893632:0@lo:502: 00000100:00100000:0.0:1787599321.210307:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9985:1874433577893760:0@lo:502: 00000100:00100000:0.0:1787599321.210345:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.210378:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060be40 going to sleep for 11 seconds 00010000:00080000:1.0:1787599321.210498:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b241091f80 x1874433577891968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.210508:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599321.210515:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787599321.210523:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599321.210534:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787599321.210538:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b243466800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599321.210548:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599321.210554:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433577891968:0@lo:8: 00000004:00080000:0.0:1787599321.210772:0:9983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787599321.210888:0:9983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 267830094738ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787599321.210894:0:9983:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787599321.211554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893760 00000100:00100000:3.0:1787599321.211562:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893760 00000100:00100000:3.0:1787599321.211603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599321.211621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:9985:x1874433577893760:12345-0@lo:502: 00000100:00100000:3.0:1787599321.211730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:9985:x1874433577893760:12345-0@lo:502: Request processed in 110us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.211737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599321.211823:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577893888:0@lo:700: 00000100:00100000:3.0:1787599321.211855:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.211881:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577893888 00000100:00100000:3.0:1787599321.211884:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577893888 00000100:00100000:3.0:1787599321.211918:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599321.211925:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9984:x1874433577893888:12345-0@lo:700: 00000100:00100000:3.0:1787599321.211952:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874433577894016:0@lo:700: 00000100:00100000:3.0:1787599321.211978:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.211994:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.212151:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9985:1874433577893760:0@lo:502: 00000040:00080000:0.0:1787599321.212185:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1787599321.212413:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894016 00000100:00100000:2.0:1787599321.212418:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894016 00000100:00100000:2.0:1787599321.212455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599321.212463:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874433577894016:12345-0@lo:700: 00000100:00080000:3.0:1787599321.212599:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:3.0:1787599321.212610:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787599321.212632:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599321.212642:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212654:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599321.212664:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787599321.212666:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b3707b1000 from 6 10000000:01000000:3.0:1787599321.212669:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599321.212694:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212713:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212722:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.212734:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894144:0@lo:101: 00000100:00100000:3.0:1787599321.212768:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.212822:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.212837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894144 00000100:00100000:3.0:1787599321.212840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894144 00000100:00100000:3.0:1787599321.212863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787599321.212869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577894144:12345-0@lo:101: 00010000:00010000:3.0:1787599321.212878:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599321.212891:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cf258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf251 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212911:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cf258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf251 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212921:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cf258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf251 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.212930:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3821d0e00, rc 0) 00000100:00100000:3.0:1787599321.212960:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577894144:12345-0@lo:101: Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.212966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787599321.213885:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.213978:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894144:0@lo:101: 00010000:00010000:3.0:1787599321.214099:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.214111:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.214162:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894272:0@lo:256: 00000100:00100000:3.0:1787599321.214204:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.214271:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b600 going to sleep for 11 seconds 00000004:00080000:1.0:1787599321.217483:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787599321.223550:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894272 00000100:00100000:2.0:1787599321.223580:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894272 00000100:00100000:3.0:1787599321.225070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787599321.225086:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577894272:12345-0@lo:256: 20000000:01000000:3.0:1787599321.225115:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599321.225139:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599321.225142:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787599321.225306:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577894272:12345-0@lo:256: Request processed in 223us (11100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.225315:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787599321.225353:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894272:0@lo:256: 10000000:01000000:3.0:1787599321.225438:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599321.225450:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225461:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599321.225473:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787599321.225475:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787599321.225479:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599321.225520:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225529:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225538:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.225556:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894400:0@lo:101: 00000100:00100000:3.0:1787599321.225607:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.225635:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.225652:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894400 00000100:00100000:3.0:1787599321.225659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894400 00000100:00100000:3.0:1787599321.225678:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787599321.225684:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577894400:12345-0@lo:101: 00010000:00010000:3.0:1787599321.225691:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599321.225718:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf25f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225742:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225751:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225760:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d200, rc 0) 00000100:00100000:3.0:1787599321.225786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577894400:12345-0@lo:101: Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.225825:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787599321.225863:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894400:0@lo:101: 00010000:00010000:3.0:1787599321.225876:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.225884:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.225935:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894528:0@lo:501: 00000100:00100000:3.0:1787599321.225960:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.225973:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344d41480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.225984:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894528 00000100:00100000:3.0:1787599321.225987:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894528 00000100:00100000:3.0:1787599321.226005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787599321.226011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577894528:12345-0@lo:501: 00000100:00100000:3.0:1787599321.226135:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577894528:12345-0@lo:501: Request processed in 123us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.226141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787599321.226168:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894528:0@lo:501: 00000100:00100000:3.0:1787599321.226190:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894656:0@lo:503: 00000100:00100000:3.0:1787599321.226222:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.226234:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344d41480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.226243:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894656 00000100:00100000:3.0:1787599321.226246:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894656 00000100:00100000:3.0:1787599321.226261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787599321.226266:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577894656:12345-0@lo:503: 00000100:00100000:3.0:1787599321.226339:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577894656:12345-0@lo:503: Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.226354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787599321.226391:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577894656:0@lo:503: 00000100:00100000:3.0:1787599321.226572:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9986:1874433577894784:0@lo:502: 00000100:00100000:3.0:1787599321.226602:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.226617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894784 00000100:00100000:3.0:1787599321.226620:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894784 00000100:00100000:3.0:1787599321.226636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787599321.226641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:9986:x1874433577894784:12345-0@lo:502: 00000100:00100000:3.0:1787599321.226715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:9986:x1874433577894784:12345-0@lo:502: Request processed in 73us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.226722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787599321.226745:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344d41240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.226755:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9986:1874433577894784:0@lo:502: 00000020:01000000:3.0:1787599321.226773:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599321.226780:0:9986:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787599321.226786:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599321.226789:0:9986:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787599321.226815:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787599321.226819:0:9986:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1787599321.226838:0:9986:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787599321.226841:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599321.226856:0:9986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96b37f8999b8) 00000020:00000080:3.0:1787599321.226877:0:9986:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787599321.226882:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787599321.226964:0:9986:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787599321.226970:0:9986:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787599321.226982:0:9986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929cf274 00010000:00080000:3.0:1787599321.227022:0:9986:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b37f8b1000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599321.227230:0:9986:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787599321.227397:0:9986:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787599321.227419:0:9986:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787599321.227580:0:9986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599321.227732:0:9986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599321.227906:0:9986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787599321.227994:0:9986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 40000000:02000000:1.0:1787599321.231310:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:2.0:1787599321.232702:0:9987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599321.232711:0:9987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787599321.234940:0:9986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599321.234954:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599321.234990:0:9986:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787599321.235956:0:9986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cf27b 00000100:00080000:3.0:1787599321.235970:0:9986:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599321.235976:0:9986:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b37f8b1000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599321.236023:0:9986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b3811d1880 x1874433577894912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599321.236052:0:9986:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787599321.236121:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599321.236127:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599321.236129:0:9986:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787599321.236134:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599321.236138:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599321.236139:0:9986:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599321.236143:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599321.236144:0:9986:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787599321.236172:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9986:1874433577895040:0@lo:502: 00000100:00100000:3.0:1787599321.236254:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.236292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895040 00000100:00100000:3.0:1787599321.236298:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895040 00000100:00100000:3.0:1787599321.236338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787599321.236347:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:9986:x1874433577895040:12345-0@lo:502: 00000100:00100000:3.0:1787599321.236481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:9986:x1874433577895040:12345-0@lo:502: Request processed in 134us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.236497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787599321.236556:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.236577:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:9986:1874433577895040:0@lo:502: 00000020:01000000:3.0:1787599321.236603:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599321.236608:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599321.236609:0:9986:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787599321.236613:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1787599321.236668:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787599321.236688:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787599321.236698:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.236710:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599321.236721:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787599321.236724:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b34dcf99b8 from 1 10000000:01000000:3.0:1787599321.236727:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787599321.236750:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.236759:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599321.236769:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599321.236781:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577895168:0@lo:101: 00000100:00100000:3.0:1787599321.236843:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.236865:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.237138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895168 00000100:00100000:2.0:1787599321.237143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895168 00000100:00100000:2.0:1787599321.237179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787599321.237187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577895168:12345-0@lo:101: 00010000:00010000:2.0:1787599321.237197:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599321.237210:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf282 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.237244:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.237255:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.237265:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6800, rc 0) 00000100:00100000:2.0:1787599321.237307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577895168:12345-0@lo:101: Request processed in 121us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.237313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787599321.237343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577894912:0@lo:8: 00000100:00100000:2.0:1787599321.237374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.237465:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577895168:0@lo:101: 00010000:00010000:0.0:1787599321.237479:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599321.237488:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599321.237537:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577895296:0@lo:501: 00000100:00100000:0.0:1787599321.237564:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.237587:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.237626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895296 00000100:00100000:3.0:1787599321.237631:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895296 00000100:00100000:3.0:1787599321.237718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787599321.237725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577895296:12345-0@lo:501: 00000100:00100000:3.0:1787599321.237821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577895296:12345-0@lo:501: Request processed in 96us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599321.237828:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787599321.240141:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577894912 00000100:00100000:1.0:1787599321.240155:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577894912 00000100:00100000:1.0:1787599321.240197:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599321.240205:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1874433577894912:12345-0@lo:8: 00010000:00080000:1.0:1787599321.240237:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1787599321.240269:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929cf290 00002000:00100000:1.0:1787599321.240283:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96b243464000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787599321.240287:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787599321.240290:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599321.240366:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599321.240391:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96b243463800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599321.240477:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433577894912:12345-0@lo:8: Request processed in 272us (3102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.240485:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787599321.240547:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d1880 x1874433577894912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.240558:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599321.240566:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787599321.240574:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599321.240579:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787599321.240609:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599321.240625:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599321.240631:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433577894912:0@lo:8: 00000100:00100000:0.0:1787599321.241298:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874433577894016:12345-0@lo:700: Request processed in 28832us (29315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.241311:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599321.241429:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d3b80 x1874433577894016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.241442:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874433577894016:0@lo:700: 40000000:02000000:1.0:1787599321.241452:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:2.0:1787599321.242679:0:9987:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787599321.242789:0:9987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 267861995794ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787599321.242823:0:9987:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787599321.243236:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577895296:0@lo:501: 10000000:01000000:2.0:1787599321.243287:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787599321.243298:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599321.243308:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787599321.246978:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787599321.253837:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577895424:0@lo:13: 00000100:00100000:2.0:1787599321.253910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.253994:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895424 00000100:00100000:1.0:1787599321.254014:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895424 00000100:00100000:1.0:1787599321.254073:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599321.254082:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577895424:12345-0@lo:13: 00002000:00000024:1.0:1787599321.254111:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:3.0:1787599321.254244:0:9988:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787599321.254269:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895552:0@lo:7: 00000100:00100000:3.0:1787599321.254300:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599321.254325:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895552 00000100:00100000:3.0:1787599321.254328:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895552 00000100:00100000:3.0:1787599321.254355:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599321.254363:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:9988:x1874433577895552:12345-0@lo:7: 00000100:00080000:0.0:1787599321.255944:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599321.257553:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433577895424:12345-0@lo:13: Request processed in 3466us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.257576:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599321.259705:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4b40 going to sleep for 11 seconds 00000001:00100000:0.0:1787599321.260165:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787599321.260173:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787599321.260284:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577893888:12345-0@lo:700: Request processed in 48356us (48425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599321.260300:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787599321.260359:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c1500 x1874433577893888/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.260375:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577893888:0@lo:700: 00002000:00080000:3.0:1787599321.261783:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787599321.261817:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787599321.261953:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9988:x1874433577895552:12345-0@lo:7: Request processed in 7587us (7647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.261963:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787599321.262185:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d2680 x1874433577895424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.262214:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577895424:0@lo:13: 00010000:00080000:1.0:1787599321.262275:0:9988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d2a00 x1874433577895552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.262285:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895552:0@lo:7: 00000004:00080000:1.0:1787599321.262294:0:9988:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787599321.262322:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895680:0@lo:5: 00000100:00100000:1.0:1787599321.262355:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.262434:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.269462:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895680 00000100:00100000:2.0:1787599321.269479:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895680 00000100:00100000:3.0:1787599321.269779:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599321.269819:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9988:x1874433577895680:12345-0@lo:5: 00002000:00080000:3.0:1787599321.269854:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787599321.269858:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787599321.270277:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9988:x1874433577895680:12345-0@lo:5: Request processed in 487us (7918us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787599321.270285:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787599321.270571:0:9988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242ddf800 x1874433577895680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.270588:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895680:0@lo:5: 00000004:00080000:2.0:1787599321.270601:0:9988:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787599321.270659:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895808:0@lo:700: 00000100:00100000:2.0:1787599321.270697:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599321.270739:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.270839:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895808 00000100:00100000:0.0:1787599321.270845:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895808 00000100:00100000:0.0:1787599321.270884:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599321.270892:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9988:x1874433577895808:12345-0@lo:700: 00000100:00100000:1.0:1787599321.271928:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577895936:0@lo:13: 00000100:00100000:1.0:1787599321.271977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787599321.272138:0:9984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787599321.272159:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896064:0@lo:7: 00000100:00100000:0.0:1787599321.272189:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.272206:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.272308:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896064 00000100:00100000:3.0:1787599321.272320:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896064 00000100:00100000:3.0:1787599321.272352:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599321.272359:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577896064:12345-0@lo:7: 00000100:00100000:2.0:1787599321.272534:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577895936 00000100:00100000:2.0:1787599321.272538:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577895936 00000100:00100000:2.0:1787599321.272609:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599321.272617:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433577895936:12345-0@lo:13: 00002000:00000024:2.0:1787599321.272629:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787599321.272733:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433577895936:12345-0@lo:13: Request processed in 117us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.272740:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787599321.272921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e3480 x1874433577895936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.272940:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577895936:0@lo:13: 00000001:00080000:0.0:1787599321.283224:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00002000:00080000:3.0:1787599321.285421:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787599321.285432:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787599321.285701:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9988:x1874433577895808:12345-0@lo:700: Request processed in 14802us (14996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.285714:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599321.285780:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577896064:12345-0@lo:7: Request processed in 13421us (13589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599321.285788:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787599321.285986:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2d80 x1874433577896064/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.286161:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896064:0@lo:7: 00000004:00080000:0.0:1787599321.286179:0:9984:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1787599321.286185:0:9988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340b800 x1874433577895808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599321.286195:0:9988:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787599321.286205:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577895808:0@lo:700: 00000100:00100000:0.0:1787599321.286222:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896192:0@lo:5: 00000100:00100000:0.0:1787599321.286257:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.286329:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599321.286369:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896192 00000100:00100000:1.0:1787599321.286376:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896192 00000100:00100000:1.0:1787599321.286426:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599321.286522:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577896192:12345-0@lo:5: 00002000:00080000:1.0:1787599321.286549:0:8629:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787599321.286616:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577896192:12345-0@lo:5: Request processed in 182us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599321.286623:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787599321.286669:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2d80 x1874433577896192/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.286691:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896192:0@lo:5: 00000004:00080000:0.0:1787599321.286699:0:9984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787599321.286719:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896320:0@lo:5: 00000100:00100000:0.0:1787599321.286739:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.286759:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599321.287783:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896320 00000100:00100000:3.0:1787599321.287867:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896320 00000100:00100000:3.0:1787599321.287907:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599321.287923:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9984:x1874433577896320:12345-0@lo:5: 00002000:00080000:3.0:1787599321.287954:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787599321.291425:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9984:x1874433577896320:12345-0@lo:5: Request processed in 3504us (4678us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787599321.291438:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787599321.291645:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2d80 x1874433577896320/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.291664:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9984:1874433577896320:0@lo:5: 00000004:00080000:0.0:1787599321.291678:0:9984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787599321.291719:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9984:1874433577896448:0@lo:900: 00000100:00100000:0.0:1787599321.291753:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599321.291780:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599321.291922:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896448 00000100:00100000:2.0:1787599321.291929:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896448 00000004:02000040:1.0:1787599321.292046:0:9988:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787599321.292115:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599321.292125:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9984:x1874433577896448:12345-0@lo:900: 00000100:00100000:2.0:1787599321.292173:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9984:x1874433577896448:12345-0@lo:900: Request processed in 51us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599321.292180:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787599321.292238:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e3480 x1874433577896448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599321.292248:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9984:1874433577896448:0@lo:900: 00000100:00100000:1.0:1787599321.294612:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242dde300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577896576:0@lo:5: 00000100:00100000:1.0:1787599321.294675:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599321.294723:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef840 going to sleep for 11 seconds 00000100:00100000:0.0:1787599321.294890:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896576 00000100:00100000:0.0:1787599321.294898:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896576 00000100:00100000:0.0:1787599321.294947:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599321.294956:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9988:x1874433577896576:12345-0@lo:5: 00002000:00080000:0.0:1787599321.301369:0:8629:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787599321.301390:0:8629:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1787599321.304476:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9988:x1874433577896576:12345-0@lo:5: Request processed in 9511us (9791us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787599321.304491:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787599321.304988:0:9988:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242dde300 x1874433577896576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599321.305060:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242dde300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9988:1874433577896576:0@lo:5: 00000004:00080000:1.0:1787599321.305077:0:9988:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1787599321.317038:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787599321.468213:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1787599321.468230:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787599322.341892:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599322.473760:0:10038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599322.473995:0:10038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787599322.662139:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577896704:0@lo:41: 00000100:00100000:3.0:1787599322.662264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.662395:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896704 00000100:00100000:0.0:1787599322.662407:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896704 00000100:00100000:0.0:1787599322.662468:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599322.662479:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577896704:12345-0@lo:41: 00000004:00000024:0.0:1787599322.662514:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787599322.662599:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577896704:12345-0@lo:41: Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.662607:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787599322.662691:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577896704:0@lo:41: 00000020:00000004:1.0:1787599323.303746:0:10086:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599323.303756:0:10086:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1787599323.368492:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599323.782528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.782740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558970496 00000100:00100000:0.0:1787599323.782754:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558970496 00000100:00100000:0.0:1787599323.782837:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1787599323.782847:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1874433558970496:12345-192.168.202.1@tcp:250: 00010000:00080000:0.0:1787599323.782878:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dd78f288-8599-4a39-80e2-c718c7b7c2ac@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1787599323.782919:0:6514:0:(genops.c:1385:class_connect()) connect: client dd78f288-8599-4a39-80e2-c718c7b7c2ac, cookie 0x5d2988b0929cf297 00000100:00080000:0.0:1787599323.783058:0:6514:0:(import.c:65:import_set_state_nolock()) ffff96b242dfe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599323.783140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+5:2402:x1874433558970496:12345-192.168.202.1@tcp:250: Request processed in 293us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599323.783148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1787599323.787472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599323.787600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558970624 00000100:00100000:3.0:1787599323.787611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558970624 00000100:00100000:3.0:1787599323.787712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:3.0:1787599323.787723:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+5:6163:x1874433558970624:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1787599323.787742:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599323.787774:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adb98a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.787856:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.787870:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.787880:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599323.787933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+6:6163:x1874433558970624:12345-192.168.202.1@tcp:101: Request processed in 213us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599323.787941:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:1.0:1787599323.793065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599323.793170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558970752 00000100:00100000:3.0:1787599323.793180:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558970752 00000100:00100000:3.0:1787599323.793245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1787599323.793256:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+6:6163:x1874433558970752:12345-192.168.202.1@tcp:501: 00000100:00100000:3.0:1787599323.793412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+6:6163:x1874433558970752:12345-192.168.202.1@tcp:501: Request processed in 158us (358us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599323.793421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:1.0:1787599323.795685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599323.795770:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558970880 00000100:00100000:3.0:1787599323.795779:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558970880 00000100:00100000:3.0:1787599323.795854:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1787599323.795865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+6:6163:x1874433558970880:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1787599323.795880:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599323.795909:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adb991 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.795955:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.795966:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.795976:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d400, rc 0) 00000100:00100000:3.0:1787599323.796120:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+7:6163:x1874433558970880:12345-192.168.202.1@tcp:101: Request processed in 256us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599323.796129:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:1.0:1787599323.801034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.801371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971008 00000100:00100000:0.0:1787599323.801389:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971008 00000100:00100000:0.0:1787599323.801492:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:0.0:1787599323.801502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+7:6163:x1874433558971008:12345-192.168.202.1@tcp:501: 00000100:00100000:0.0:1787599323.801669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6163:x1874433558971008:12345-192.168.202.1@tcp:501: Request processed in 168us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599323.801692:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:1.0:1787599323.816589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599323.816851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971136 00000100:00100000:2.0:1787599323.816861:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971136 00000100:00100000:2.0:1787599323.816923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:2.0:1787599323.816934:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6163:x1874433558971136:12345-192.168.202.1@tcp:503: 00000100:00100000:2.0:1787599323.817080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6163:x1874433558971136:12345-192.168.202.1@tcp:503: Request processed in 148us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599323.817089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1787599323.820711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.820823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971264 00000100:00100000:0.0:1787599323.820834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971264 00000100:00100000:0.0:1787599323.820889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:0.0:1787599323.820899:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6182:x1874433558971264:12345-192.168.202.1@tcp:502: 00000100:00100000:0.0:1787599323.821061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6182:x1874433558971264:12345-192.168.202.1@tcp:502: Request processed in 163us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599323.821069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:1.0:1787599323.851312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.852132:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971392 00000100:00100000:0.0:1787599323.852144:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971392 00000100:00100000:0.0:1787599323.852206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:0.0:1787599323.852226:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6182:x1874433558971392:12345-192.168.202.1@tcp:502: 00000100:00100000:0.0:1787599323.852401:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6182:x1874433558971392:12345-192.168.202.1@tcp:502: Request processed in 185us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599323.852409:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:1.0:1787599323.858179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599323.858304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971520 00000100:00100000:2.0:1787599323.858314:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971520 00000100:00100000:2.0:1787599323.858434:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:2.0:1787599323.858447:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6163:x1874433558971520:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1787599323.858463:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599323.858480:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6000/0x5d2988b0929cf2ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adb9c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599323.858507:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6000/0x5d2988b0929cf2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c2 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599323.858519:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6000/0x5d2988b0929cf2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c2 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599323.858528:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6000, rc 0) 00000100:00100000:2.0:1787599323.858592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6163:x1874433558971520:12345-192.168.202.1@tcp:101: Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599323.858622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1787599323.870852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.871002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971648 00000100:00100000:0.0:1787599323.871014:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971648 00000100:00100000:0.0:1787599323.871075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1787599323.871085:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6163:x1874433558971648:12345-192.168.202.1@tcp:256: 20000000:01000000:0.0:1787599323.871109:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787599323.871135:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787599323.871139:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787599323.871141:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787599323.871144:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787599323.871146:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787599323.874837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6163:x1874433558971648:12345-192.168.202.1@tcp:256: Request processed in 3741us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599323.874852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:2.0:1787599323.878179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599323.878275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971776 00000100:00100000:3.0:1787599323.878286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971776 00000100:00100000:3.0:1787599323.878343:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1787599323.878354:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6163:x1874433558971776:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1787599323.878373:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599323.878399:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adb9c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.878428:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.878438:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599323.878459:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c000, rc 0) 00000100:00100000:3.0:1787599323.878522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6163:x1874433558971776:12345-192.168.202.1@tcp:101: Request processed in 170us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599323.878556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1787599323.885932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599323.886030:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558971904 00000100:00100000:2.0:1787599323.886043:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558971904 00000100:00100000:2.0:1787599323.886106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1787599323.886117:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6163:x1874433558971904:12345-192.168.202.1@tcp:501: 00000100:00100000:2.0:1787599323.886294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6163:x1874433558971904:12345-192.168.202.1@tcp:501: Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599323.886303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1787599323.890886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599323.891160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972032 00000100:00100000:1.0:1787599323.891171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972032 00000100:00100000:1.0:1787599323.891235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:1.0:1787599323.891247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6163:x1874433558972032:12345-192.168.202.1@tcp:503: 00000100:00100000:1.0:1787599323.891417:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6163:x1874433558972032:12345-192.168.202.1@tcp:503: Request processed in 171us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599323.891426:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:1.0:1787599323.897176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599323.897571:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972160 00000100:00100000:3.0:1787599323.897581:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972160 00000100:00100000:3.0:1787599323.897642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:3.0:1787599323.897654:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6188:x1874433558972160:12345-192.168.202.1@tcp:502: 00000100:00100000:3.0:1787599323.898241:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6188:x1874433558972160:12345-192.168.202.1@tcp:502: Request processed in 587us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599323.898250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:3.0:1787599323.902975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599323.903083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972288 00000100:00100000:2.0:1787599323.903094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972288 00000100:00100000:2.0:1787599323.903155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:2.0:1787599323.903165:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6188:x1874433558972288:12345-192.168.202.1@tcp:502: 00000100:00100000:2.0:1787599323.903337:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6188:x1874433558972288:12345-192.168.202.1@tcp:502: Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599323.903346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1787599323.909953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599323.909997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599323.910270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972416 00000100:00100000:1.0:1787599323.910281:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972416 00000100:00100000:1.0:1787599323.910326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972672 00000100:00100000:1.0:1787599323.910329:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972672 00000100:00100000:1.0:1787599323.910341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1787599323.910349:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874433558972416:12345-192.168.202.1@tcp:38: 00010000:00080000:1.0:1787599323.910386:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1787599323.910437:0:6520:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf2ba 00000004:00100000:1.0:1787599323.910469:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787599323.910686:0:6520:0:(import.c:65:import_set_state_nolock()) ffff96b243466000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599323.910762:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433558972416:12345-192.168.202.1@tcp:38: Request processed in 412us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599323.910770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1787599323.910832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599323.910837:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874433558972672:12345-192.168.202.1@tcp:38: 00010000:00080000:1.0:1787599323.910852:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1787599323.910885:0:6520:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf2c1 00000004:00100000:1.0:1787599323.911119:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787599323.911287:0:6520:0:(import.c:65:import_set_state_nolock()) ffff96b37f8e6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599323.911319:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433558972672:12345-192.168.202.1@tcp:38: Request processed in 480us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599323.911326:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1787599324.205031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577896832:0@lo:41: 00000100:00100000:2.0:1787599324.205113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599324.205309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896832 00000100:00100000:1.0:1787599324.205318:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896832 00000100:00100000:1.0:1787599324.205369:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599324.205387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577896832:12345-0@lo:41: 00000004:00000024:1.0:1787599324.205424:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599324.205515:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577896832:12345-0@lo:41: Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599324.205523:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787599324.205716:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577896832:0@lo:41: 00010000:00010000:1.0:1787599324.391694:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599324.918918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599324.918961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599324.919052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972544 00000100:00100000:0.0:1787599324.919063:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972544 00000100:00100000:0.0:1787599324.919132:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972800 00000100:00100000:0.0:1787599324.919135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972800 00000100:00100000:1.0:1787599324.919148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599324.919164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433558972544:12345-192.168.202.1@tcp:41: 00000100:00080000:3.0:1787599324.919184:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599324.919188:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787599324.919215:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787599324.919294:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433558972544:12345-192.168.202.1@tcp:41: Request processed in 136us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599324.922454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599324.923159:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787599324.923174:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787599324.923876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558972928 00000100:00100000:3.0:1787599324.923894:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558972928 00000100:00100000:0.0:1787599324.924571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599324.924588:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433558972800:12345-192.168.202.1@tcp:41: 00000004:00000024:0.0:1787599324.924631:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599324.924715:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433558972800:12345-192.168.202.1@tcp:41: Request processed in 133us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599324.924723:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1787599324.931094:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1787599324.935482:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1787599324.935513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558972928:12345-192.168.202.1@tcp:41: 00000004:00000024:3.0:1787599324.935568:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787599324.935674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558972928:12345-192.168.202.1@tcp:41: Request processed in 174us (13231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599324.935682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1787599324.942205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599324.942277:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973056 00000100:00100000:2.0:1787599324.942301:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973056 00000100:00100000:2.0:1787599324.942360:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1787599324.942381:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973056:12345-192.168.202.1@tcp:40: 00000100:00100000:2.0:1787599324.942471:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973056:12345-192.168.202.1@tcp:40: Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599324.942478:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1787599324.945383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599324.945423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599324.945510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599324.945551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599324.945861:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973440 00000100:00100000:3.0:1787599324.945871:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973440 00000100:00100000:3.0:1787599324.946123:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599324.946135:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973440:12345-192.168.202.1@tcp:900: 00000100:00100000:3.0:1787599324.946224:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973440:12345-192.168.202.1@tcp:900: Request processed in 91us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599324.946232:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599324.946261:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973184 00000100:00100000:3.0:1787599324.946265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973184 00000100:00100000:3.0:1787599324.946282:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973312 00000100:00100000:3.0:1787599324.946285:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973312 00000100:00100000:3.0:1787599324.946301:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1787599324.946306:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874433558973184:12345-192.168.202.1@tcp:8: 00010000:00080000:3.0:1787599324.946332:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1787599324.946378:0:8433:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf2c8 00002000:00100000:3.0:1787599324.946391:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4ef2ef44-63df-45fd-9e68-c54398cec083/ffff96b2434d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787599324.946409:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787599324.946644:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787599324.946673:0:8433:0:(import.c:65:import_set_state_nolock()) ffff96b2434d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599324.946710:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433558973184:12345-192.168.202.1@tcp:8: Request processed in 402us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599324.946717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1787599324.946735:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1787599324.946740:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874433558973312:12345-192.168.202.1@tcp:8: 00010000:00080000:3.0:1787599324.946758:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1787599324.946778:0:8433:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf2cf 00002000:00100000:3.0:1787599324.946783:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4ef2ef44-63df-45fd-9e68-c54398cec083/ffff96b2434d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787599324.946855:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787599324.947436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973568 00000100:00100000:2.0:1787599324.947444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973568 00000100:00100000:2.0:1787599324.947482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:2.0:1787599324.947490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2403:x1874433558973568:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1787599324.947545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2403:x1874433558973568:12345-192.168.202.1@tcp:400: Request processed in 54us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599324.947552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:1.0:1787599324.950561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599324.950674:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973696 00000100:00100000:0.0:1787599324.950685:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973696 00000100:00100000:0.0:1787599324.950744:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1787599324.950755:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973696:12345-192.168.202.1@tcp:33: 00002000:00080000:3.0:1787599324.952021:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787599324.952065:0:8433:0:(import.c:65:import_set_state_nolock()) ffff96b2434d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599324.952149:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433558973312:12345-192.168.202.1@tcp:8: Request processed in 5403us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599324.952169:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000004:00080000:0.0:1787599324.979653:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28793us 00000004:00200000:0.0:1787599324.989406:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787599324.989586:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6163:x1874433558973696:12345-192.168.202.1@tcp:33: Request processed in 38768us (38966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599324.989599:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599325.177549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599325.177681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973824 00000100:00100000:0.0:1787599325.177693:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973824 00000100:00100000:0.0:1787599325.177764:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1787599325.177781:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6206:x1874433558973824:12345-192.168.202.1@tcp:101: 00010000:00010000:0.0:1787599325.177855:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599325.177919:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325a00/0x5d2988b0929cf2d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adb9fa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.177983:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.177996:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.178011:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599325.178058:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599325.178062:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599325.178078:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.178102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325a00/0x5d2988b0929cf2d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9fa expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.178119:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9fa expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599325.178128:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403100) 00010000:00010000:0.0:1787599325.178131:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599325.178135:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325600, rc 0) 00000100:00100000:0.0:1787599325.178193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:6206:x1874433558973824:12345-192.168.202.1@tcp:101: Request processed in 419us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599325.178201:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:3.0:1787599325.417003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599326.245604:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599326.245625:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577896960:0@lo:13: 00000100:00100000:0.0:1787599326.245713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599326.245778:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577896960 00000100:00100000:0.0:1787599326.245786:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577896960 00000100:00100000:0.0:1787599326.245855:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599326.245864:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577896960:12345-0@lo:13: 00002000:00000024:0.0:1787599326.245884:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599326.245917:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577896960:12345-0@lo:13: Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599326.245922:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787599326.245962:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2300 x1874433577896960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599326.245977:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577896960:0@lo:13: 00000100:00100000:1.0:1787599326.246112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577897344:0@lo:400: 00000100:00100000:1.0:1787599326.246136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246149:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577897856:0@lo:400: 00000100:00100000:1.0:1787599326.246180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246196:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577898368:0@lo:400: 00000100:00100000:1.0:1787599326.246217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246242:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599326.246248:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577897472:0@lo:400: 00000100:00100000:1.0:1787599326.246275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246287:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577897984:0@lo:400: 00000100:00100000:1.0:1787599326.246299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246308:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577898496:0@lo:400: 00000100:00100000:1.0:1787599326.246319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599326.246342:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898368 00000100:00100000:1.0:1787599326.246347:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898368 00000100:00100000:1.0:1787599326.246400:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897984 00000100:00100000:1.0:1787599326.246403:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897984 00000100:00100000:1.0:1787599326.246414:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898496 00000100:00100000:1.0:1787599326.246415:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898496 00000100:00100000:1.0:1787599326.246433:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599326.246438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577898368:12345-0@lo:400: 00000100:00100000:1.0:1787599326.246466:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577898368:12345-0@lo:400: Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.246478:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599326.246488:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599326.246492:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577897984:12345-0@lo:400: 00000100:00100000:1.0:1787599326.246509:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577897984:12345-0@lo:400: Request processed in 17us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.246512:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599326.246518:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599326.246521:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577898496:12345-0@lo:400: 00000100:00100000:1.0:1787599326.246533:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577898496:12345-0@lo:400: Request processed in 12us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.246536:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599326.246547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897856 00000100:00100000:1.0:1787599326.246549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897856 00000100:00100000:1.0:1787599326.246567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897472 00000100:00100000:1.0:1787599326.246569:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897472 00000100:00100000:1.0:1787599326.246578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787599326.246581:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577897856:12345-0@lo:400: 00000100:00100000:1.0:1787599326.246599:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577897856:12345-0@lo:400: Request processed in 18us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.246603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787599326.246609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599326.246612:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577897472:12345-0@lo:400: 00000100:00100000:1.0:1787599326.246624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577897472:12345-0@lo:400: Request processed in 12us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.246627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599326.246649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577897472:0@lo:400: 00010000:00080000:1.0:1787599326.246662:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370013800 x1874433577897984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599326.246669:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577897984:0@lo:400: 00010000:00080000:1.0:1787599326.246674:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3100 x1874433577898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599326.246679:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787599326.246690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577898496:0@lo:400: 00010000:00080000:1.0:1787599326.246696:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370010a80 x1874433577897856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599326.246701:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577897856:0@lo:400: 00010000:00080000:1.0:1787599326.246706:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a0a80 x1874433577898368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599326.246710:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787599326.246718:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577898368:0@lo:400: 00000100:00080000:3.0:1787599326.246926:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599326.246930:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599326.246931:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599326.246939:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577897216:0@lo:400: 00000100:00100000:3.0:1787599326.246962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.246984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577897728:0@lo:400: 00000100:00100000:3.0:1787599326.247000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247015:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577898240:0@lo:400: 00000100:00100000:3.0:1787599326.247029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787599326.247044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577897088:0@lo:400: 00000100:00100000:3.0:1787599326.247060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247073:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577897600:0@lo:400: 00000100:00100000:3.0:1787599326.247084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247094:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577898112:0@lo:400: 00000100:00100000:3.0:1787599326.247105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247110:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577898624:0@lo:13: 00000100:00100000:3.0:1787599326.247130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.247150:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897344 00000100:00100000:3.0:1787599326.247153:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897344 00000100:00100000:3.0:1787599326.247171:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897600 00000100:00100000:3.0:1787599326.247177:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897600 00000100:00100000:3.0:1787599326.247196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599326.247203:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577897344:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247238:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577897344:12345-0@lo:400: Request processed in 36us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247245:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599326.247258:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787599326.247262:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577897600:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247284:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577897600:12345-0@lo:400: Request processed in 22us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787599326.247302:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897216 00000100:00100000:3.0:1787599326.247304:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897216 00000100:00100000:3.0:1787599326.247313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897728 00000100:00100000:3.0:1787599326.247314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897728 00000100:00100000:3.0:1787599326.247328:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898240 00000100:00100000:3.0:1787599326.247330:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898240 00000100:00100000:3.0:1787599326.247340:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898112 00000100:00100000:3.0:1787599326.247342:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898112 00000100:00100000:3.0:1787599326.247353:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787599326.247372:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577897216:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247399:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577897216:12345-0@lo:400: Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247403:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787599326.247411:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599326.247414:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577897728:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247441:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577897728:12345-0@lo:400: Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599326.247459:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599326.247463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577898240:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247480:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577898240:12345-0@lo:400: Request processed in 17us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599326.247488:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787599326.247492:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577898112:12345-0@lo:400: 00000100:00100000:3.0:1787599326.247504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577898112:12345-0@lo:400: Request processed in 12us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787599326.247515:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599326.247517:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599326.247522:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898624 00000100:00100000:3.0:1787599326.247524:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898624 00000100:00100000:3.0:1787599326.247536:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599326.247539:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577898624:12345-0@lo:13: 00002000:00000024:3.0:1787599326.247548:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599326.247564:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577898624:12345-0@lo:13: Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599326.247568:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599326.247585:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577897600:0@lo:400: 00000100:00100000:3.0:1787599326.247591:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577898112:0@lo:400: 00010000:00080000:3.0:1787599326.247597:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340bb80 x1874433577898624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599326.247614:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577898624:0@lo:13: 00000100:00100000:3.0:1787599326.247621:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577897216:0@lo:400: 00000100:00100000:3.0:1787599326.247667:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577897728:0@lo:400: 00010000:00080000:3.0:1787599326.247674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a0380 x1874433577898240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599326.247679:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577898240:0@lo:400: 00000100:00100000:1.0:1787599326.251862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577897088 00000100:00100000:1.0:1787599326.251879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577897088 00000100:00100000:1.0:1787599326.251956:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787599326.251964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577897088:12345-0@lo:400: 00000100:00100000:1.0:1787599326.252050:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577897088:12345-0@lo:400: Request processed in 88us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599326.252056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787599326.252114:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577897344:0@lo:400: 00000100:00100000:3.0:1787599326.254112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577897088:0@lo:400: 00010000:00010000:1.0:1787599326.437705:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599326.757162:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577898752:0@lo:13: 00000100:00100000:3.0:1787599326.757183:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599326.757238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599326.757239:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577898880:0@lo:13: 00000100:00100000:2.0:1787599326.757317:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898752 00000100:00100000:2.0:1787599326.757327:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898752 00000100:00100000:2.0:1787599326.757393:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599326.757408:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577898752:12345-0@lo:13: 00002000:00000024:2.0:1787599326.757446:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599326.762948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599326.763658:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787599326.763673:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787599326.764289:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577898880 00000100:00100000:1.0:1787599326.764300:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577898880 00000100:00100000:0.0:1787599326.764468:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599326.764478:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577898880:12345-0@lo:13: 00002000:00000024:0.0:1787599326.764511:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599326.764593:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577898880:12345-0@lo:13: Request processed in 116us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599326.764599:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787599326.764732:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1880 x1874433577898880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599326.764752:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577898880:0@lo:13: 00000100:00100000:2.0:1787599326.771377:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577898752:12345-0@lo:13: Request processed in 13960us (14128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599326.771392:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787599326.773343:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2300 x1874433577898752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599326.773381:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577898752:0@lo:13: 00010000:00010000:3.0:1787599327.467585:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599327.487669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599327.489099:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558973952 00000100:00100000:3.0:1787599327.489115:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558973952 00000100:00100000:3.0:1787599327.489220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1787599327.489241:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:6258:x1874433558973952:12345-192.168.202.1@tcp:41: 00000004:00000024:3.0:1787599327.489282:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787599327.489408:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:6258:x1874433558973952:12345-192.168.202.1@tcp:41: Request processed in 178us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599327.489417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:0.0:1787599327.490018:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599327.492526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599327.492689:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974080 00000100:00100000:2.0:1787599327.492707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974080 00000100:00100000:2.0:1787599327.492781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599327.492819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974080:12345-192.168.202.1@tcp:41: 00000004:00000024:2.0:1787599327.492864:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599327.492963:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974080:12345-192.168.202.1@tcp:41: Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599327.492971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:0.0:1787599327.493043:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599327.508966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599327.511421:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974208 00000100:00100000:0.0:1787599327.511440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974208 00000100:00100000:0.0:1787599327.511701:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599327.511731:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974208:12345-192.168.202.1@tcp:13: 00002000:00000024:0.0:1787599327.511769:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599327.511875:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974208:12345-192.168.202.1@tcp:13: Request processed in 148us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599327.511883:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:3.0:1787599327.516009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599327.516443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599327.519392:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974336 00000100:00100000:3.0:1787599327.519410:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974336 00000100:00100000:1.0:1787599327.519711:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599327.519726:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974336:12345-192.168.202.1@tcp:13: 00002000:00000024:1.0:1787599327.519753:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599327.519874:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4ef2ef44-63df-45fd-9e68-c54398cec083+6:6258:x1874433558974336:12345-192.168.202.1@tcp:13: Request processed in 152us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599327.519882:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00080000:0.0:1787599327.520010:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599327.784278:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577899008:0@lo:41: 00000100:00100000:3.0:1787599327.784374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599327.784635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899008 00000100:00100000:0.0:1787599327.784644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899008 00000100:00100000:0.0:1787599327.784707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599327.784717:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577899008:12345-0@lo:41: 00000004:00000024:0.0:1787599327.784746:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787599327.784822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577899008:12345-0@lo:41: Request processed in 106us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599327.784829:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787599327.785030:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577899008:0@lo:41: 00010000:00010000:1.0:1787599328.490942:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599329.323066:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577899136:0@lo:41: 00000100:00100000:1.0:1787599329.323135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599329.323211:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899136 00000100:00100000:1.0:1787599329.323218:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899136 00000100:00100000:1.0:1787599329.323276:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599329.323286:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577899136:12345-0@lo:41: 00000004:00000024:1.0:1787599329.323319:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599329.323374:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577899136:12345-0@lo:41: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599329.323381:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599329.323429:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577899136:0@lo:41: 00000001:00100000:2.0:1787599329.323657:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000001:00100000:3.0:1787599329.326423:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000001:00100000:0.0:1787599329.334106:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00010000:00010000:3.0:1787599329.512085:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599330.252207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599330.252245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599330.252275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599330.252302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599330.252345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599330.252365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974464 00000100:00100000:2.0:1787599330.252369:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974592 00000100:00100000:2.0:1787599330.252376:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974592 00000100:00100000:0.0:1787599330.252376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974464 00000100:00100000:2.0:1787599330.252424:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974720 00000100:00100000:2.0:1787599330.252427:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974720 00000100:00100000:0.0:1787599330.252429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1787599330.252438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558974464:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1787599330.252447:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1787599330.252454:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558974592:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1787599330.252520:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599330.252530:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558974720:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1787599330.252584:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558974592:12345-192.168.202.1@tcp:400: Request processed in 131us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599330.252591:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1787599330.252612:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974848 00000100:00100000:2.0:1787599330.252615:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974848 00000100:00100000:2.0:1787599330.252640:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558974976 00000100:00100000:2.0:1787599330.252643:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558974976 00000100:00100000:2.0:1787599330.252662:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1787599330.252667:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558974848:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1787599330.262106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558974464:12345-192.168.202.1@tcp:400: Request processed in 9654us (9894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599330.262122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:3.0:1787599330.262979:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558974720:12345-192.168.202.1@tcp:400: Request processed in 10444us (10696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599330.262992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1787599330.263289:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558974848:12345-192.168.202.1@tcp:400: Request processed in 10618us (10983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599330.263300:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1787599330.263343:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1787599330.263357:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558974976:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1787599330.263417:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558974976:12345-192.168.202.1@tcp:400: Request processed in 66us (11071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599330.263423:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1787599330.263453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599330.263461:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599330.263466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599330.263470:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787599330.344083:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000001:02000400:0.0:1787599330.351426:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787599330.533098:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599331.366821:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599331.366850:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577899264:0@lo:13: 00000100:00100000:1.0:1787599331.366930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599331.367007:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577899648:0@lo:400: 00000100:00100000:1.0:1787599331.367040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599331.367059:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577900160:0@lo:400: 00000100:00100000:1.0:1787599331.367083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599331.367098:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599331.367116:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577899776:0@lo:400: 00000100:00100000:1.0:1787599331.367138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599331.367154:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577900288:0@lo:400: 00000100:00100000:3.0:1787599331.367298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577899520:0@lo:400: 00000100:00100000:3.0:1787599331.367340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.367344:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899264 00000100:00100000:2.0:1787599331.367354:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899264 00000100:00100000:3.0:1787599331.367364:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577900032:0@lo:400: 00000100:00100000:3.0:1787599331.367387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599331.367406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577900544:0@lo:400: 00000100:00100000:2.0:1787599331.367422:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599331.367430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.367437:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577899264:12345-0@lo:13: 00000100:00100000:3.0:1787599331.367444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787599331.367452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577899392:0@lo:400: 00002000:00000024:2.0:1787599331.367469:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599331.367493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599331.367525:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577899904:0@lo:400: 00000100:00100000:2.0:1787599331.367527:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577899264:12345-0@lo:13: Request processed in 94us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.367537:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599331.367553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.367573:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900160 00000100:00100000:3.0:1787599331.367576:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577900416:0@lo:400: 00000100:00100000:2.0:1787599331.367579:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900160 00000100:00100000:3.0:1787599331.367603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.367609:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899776 00000100:00100000:0.0:1787599331.367611:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899392 00000100:00100000:2.0:1787599331.367615:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899776 00000100:00100000:0.0:1787599331.367617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899392 00000100:00100000:3.0:1787599331.367628:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899648 00000100:00100000:3.0:1787599331.367631:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899648 00000100:00100000:2.0:1787599331.367634:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899520 00000100:00100000:2.0:1787599331.367639:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899520 00000100:00100000:0.0:1787599331.367655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787599331.367656:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577899904 00000100:00100000:3.0:1787599331.367659:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577899904 00000100:00100000:2.0:1787599331.367661:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900032 00000100:00100000:0.0:1787599331.367666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577899392:12345-0@lo:400: 00000100:00100000:2.0:1787599331.367668:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900032 00000100:00100000:3.0:1787599331.367677:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599331.367686:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577899648:12345-0@lo:400: 00000100:00100000:2.0:1787599331.367690:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900544 00000100:00100000:2.0:1787599331.367695:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900544 00000100:00100000:2.0:1787599331.367712:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900416 00000100:00100000:2.0:1787599331.367715:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900416 00000100:00100000:3.0:1787599331.367723:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577899648:12345-0@lo:400: Request processed in 39us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599331.367723:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577899392:12345-0@lo:400: Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599331.367733:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787599331.367733:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787599331.367735:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599331.367751:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599331.367756:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577900160:12345-0@lo:400: 00000100:00100000:3.0:1787599331.367763:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577899904:12345-0@lo:400: 00000100:00100000:0.0:1787599331.367764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787599331.367772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577899776:12345-0@lo:400: 00000100:00100000:2.0:1787599331.367840:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577900160:12345-0@lo:400: Request processed in 89us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.367848:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599331.367862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.367865:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787599331.367873:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577899520:12345-0@lo:400: 00010000:00080000:1.0:1787599331.367901:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87f100 x1874433577900160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599331.367910:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577899520:12345-0@lo:400: Request processed in 36us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.367920:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599331.367920:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577900160:0@lo:400: 00000100:00100000:2.0:1787599331.367939:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599331.367941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577899648:0@lo:400: 00000100:00100000:2.0:1787599331.367949:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577900032:12345-0@lo:400: 00010000:00080000:1.0:1787599331.367956:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2680 x1874433577899264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599331.367959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577899776:12345-0@lo:400: Request processed in 53us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599331.367968:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599331.367973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577899264:0@lo:13: 00000100:00100000:2.0:1787599331.367985:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577900032:12345-0@lo:400: Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.367992:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599331.368001:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577900672:0@lo:400: 00000100:00100000:2.0:1787599331.368009:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599331.368017:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577900544:12345-0@lo:400: 00000100:00100000:1.0:1787599331.368031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.368058:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577900544:12345-0@lo:400: Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599331.368066:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577899776:0@lo:400: 00000100:00100000:2.0:1787599331.368067:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599331.368085:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599331.368085:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599331.368095:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577900800:0@lo:400: 00000100:00100000:2.0:1787599331.368098:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577900416:12345-0@lo:400: 00000100:00080000:0.0:1787599331.368115:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599331.368120:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599331.368124:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599331.368133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.368143:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577900416:12345-0@lo:400: Request processed in 47us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.368150:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599331.368173:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900288 00000100:00100000:0.0:1787599331.368178:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900288 00000100:00100000:0.0:1787599331.368208:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900672 00000100:00100000:0.0:1787599331.368211:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900672 00000100:00100000:0.0:1787599331.368222:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900800 00000100:00100000:0.0:1787599331.368225:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900800 00000100:00100000:0.0:1787599331.368239:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599331.368244:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577900288:12345-0@lo:400: 00000100:00100000:0.0:1787599331.368278:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577900288:12345-0@lo:400: Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599331.368284:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599331.368295:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599331.368301:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577900672:12345-0@lo:400: 00000100:00100000:0.0:1787599331.368338:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577900672:12345-0@lo:400: Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599331.368345:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599331.368355:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599331.368367:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577900800:12345-0@lo:400: 00000100:00100000:0.0:1787599331.368392:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577900800:12345-0@lo:400: Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599331.368398:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787599331.368410:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599331.368412:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599331.368438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87ea00 x1874433577900800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599331.368447:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577900800:0@lo:400: 00000100:00100000:3.0:1787599331.368540:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577899904:12345-0@lo:400: Request processed in 778us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599331.368546:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599331.368593:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577899392:0@lo:400: 00000100:00100000:3.0:1787599331.368603:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577899904:0@lo:400: 00000100:00100000:3.0:1787599331.368611:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577900416:0@lo:400: 00000100:00100000:3.0:1787599331.368620:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577899520:0@lo:400: 00000100:00100000:3.0:1787599331.368629:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577900032:0@lo:400: 00010000:00080000:3.0:1787599331.368648:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87d880 x1874433577900544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599331.368657:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577900544:0@lo:400: 00000100:00100000:3.0:1787599331.368674:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599331.368680:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577900928:0@lo:13: 00000100:00100000:3.0:1787599331.368704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599331.368727:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577900928 00000100:00100000:3.0:1787599331.368731:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577900928 00000100:00100000:3.0:1787599331.368754:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599331.368760:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577900928:12345-0@lo:13: 00002000:00000024:3.0:1787599331.368771:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599331.368822:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577900928:12345-0@lo:13: Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599331.368828:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787599331.368850:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87e680 x1874433577900928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599331.368862:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577900928:0@lo:13: 00010000:00080000:0.0:1787599331.368952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87e300 x1874433577900672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599331.368964:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577900672:0@lo:400: 00010000:00080000:0.0:1787599331.368977:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87ce00 x1874433577900288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599331.368984:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577900288:0@lo:400: 00010000:00010000:3.0:1787599331.557203:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599331.877078:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577901056:0@lo:13: 00000100:00100000:3.0:1787599331.877152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599331.877352:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901056 00000100:00100000:2.0:1787599331.877362:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901056 00000100:00100000:2.0:1787599331.877435:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599331.877445:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577901056:12345-0@lo:13: 00002000:00000024:2.0:1787599331.877475:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599331.877521:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577901056:12345-0@lo:13: Request processed in 77us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599331.877528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787599331.877707:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340aa00 x1874433577901056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599331.877725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577901056:0@lo:13: 00000100:00100000:0.0:1787599331.880184:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577901184:0@lo:13: 00000100:00100000:0.0:1787599331.880245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599331.880417:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901184 00000100:00100000:3.0:1787599331.880425:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901184 00000100:00100000:3.0:1787599331.880485:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599331.880495:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577901184:12345-0@lo:13: 00002000:00000024:3.0:1787599331.880518:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599331.880561:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577901184:12345-0@lo:13: Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599331.880569:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787599331.880652:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87ce00 x1874433577901184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599331.880670:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577901184:0@lo:13: 00010000:00010000:1.0:1787599332.581315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599332.906118:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577901312:0@lo:41: 00000100:00100000:3.0:1787599332.906191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599332.906316:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901312 00000100:00100000:2.0:1787599332.906323:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901312 00000100:00100000:2.0:1787599332.906371:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787599332.906380:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577901312:12345-0@lo:41: 00000004:00000024:2.0:1787599332.906410:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787599332.906483:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577901312:12345-0@lo:41: Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599332.906489:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787599332.906532:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577901312:0@lo:41: 00010000:00010000:3.0:1787599333.607084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599334.437069:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577901440:0@lo:41: 00000100:00100000:3.0:1787599334.437162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599334.437348:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901440 00000100:00100000:1.0:1787599334.437359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901440 00000100:00100000:1.0:1787599334.437430:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599334.437439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577901440:12345-0@lo:41: 00000004:00000024:1.0:1787599334.437483:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599334.437527:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577901440:12345-0@lo:41: Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599334.437534:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599334.437670:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577901440:0@lo:41: 00010000:00010000:1.0:1787599334.628990:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599335.071184:0:10334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd313b8560 20000000:00000080:2.0:1787599335.071202:0:10334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b242c24800 uarg=0000000000000000 20000000:01000000:2.0:1787599335.071243:0:10334:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787599335.071245:0:10334:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787599335.071248:0:10334:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787599335.071252:0:10334:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787599335.071257:0:10334:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787599335.071325:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787599335.071327:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599335.071779:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787599335.072429:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787599335.072520:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787599335.072534:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787599335.072545:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787599335.072547:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599335.073088:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787599335.073240:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787599335.073260:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787599335.073276:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787599335.073297:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787599335.073299:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599335.073597:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787599335.073737:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787599335.073757:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787599335.073772:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787599335.073780:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787599335.073782:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599335.074217:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787599335.074370:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787599335.074387:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787599335.074415:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787599335.074425:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787599335.074426:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599335.074922:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787599335.075234:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787599335.075258:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787599335.075271:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1787599335.075295:0:10334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787599335.075316:0:10334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075333:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075341:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075347:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075353:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075370:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075377:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075382:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075389:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075396:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075404:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075410:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075418:0:10334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075517:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075533:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.075556:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901568:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599335.075775:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075785:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.075830:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901696:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599335.075863:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075871:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.075879:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901824:0@lo:104: 00000100:00100000:2.0:1787599335.075912:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599335.075948:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.075955:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.075962:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901952:0@lo:104: 00000100:00100000:2.0:1787599335.075982:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599335.076003:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076011:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076027:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902080:0@lo:104: 00000100:00100000:2.0:1787599335.076047:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599335.076065:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076072:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076079:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902208:0@lo:104: 00000100:00100000:2.0:1787599335.076096:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599335.076109:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076117:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076124:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902336:0@lo:104: 00010000:00010000:2.0:1787599335.076172:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076180:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076188:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902464:0@lo:104: 00010000:00010000:2.0:1787599335.076213:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076221:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076234:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902592:0@lo:104: 00010000:00010000:2.0:1787599335.076255:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076261:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076268:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902720:0@lo:104: 00010000:00010000:2.0:1787599335.076299:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.076307:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.076315:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902848:0@lo:104: 00000100:00100000:2.0:1787599335.076329:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599335.076628:0:8450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787599335.076647:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.076661:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.076671:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.076679:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.076687:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.076696:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901824 00000100:00100000:3.0:1787599335.076702:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901824 00000100:00100000:3.0:1787599335.076737:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577901952 00000100:00100000:3.0:1787599335.076740:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577901952 00000100:00100000:3.0:1787599335.076749:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902080 00000100:00100000:3.0:1787599335.076751:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902080 00000100:00100000:3.0:1787599335.076758:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902208 00000100:00100000:3.0:1787599335.076759:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902208 00000100:00100000:3.0:1787599335.076766:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902336 00000100:00100000:3.0:1787599335.076768:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902336 00000100:00100000:3.0:1787599335.076775:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902464 00000100:00100000:3.0:1787599335.076777:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902464 00000100:00100000:3.0:1787599335.076824:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902592 00000100:00100000:3.0:1787599335.076827:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902592 00000100:00100000:3.0:1787599335.076836:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902720 00000100:00100000:3.0:1787599335.076838:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902720 00000100:00100000:3.0:1787599335.076844:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902848 00000100:00100000:3.0:1787599335.076846:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902848 00000100:00100000:3.0:1787599335.076856:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599335.076866:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:10334:x1874433577901824:12345-0@lo:104: 00010000:00010000:3.0:1787599335.076877:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.076929:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599335.076935:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+11:10334:x1874433577901824:12345-0@lo:104: Request processed in 71us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.076942:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599335.076957:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599335.076962:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:10334:x1874433577901952:12345-0@lo:104: 00010000:00010000:3.0:1787599335.076970:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077003:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787599335.077008:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+10:10334:x1874433577901952:12345-0@lo:104: Request processed in 45us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077014:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599335.077026:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599335.077032:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:10334:x1874433577902080:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077039:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077077:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787599335.077082:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+9:10334:x1874433577902080:12345-0@lo:104: Request processed in 51us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077087:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599335.077097:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599335.077102:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242172c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+8:10334:x1874433577902208:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077109:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077132:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787599335.077137:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242172c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+8:10334:x1874433577902208:12345-0@lo:104: Request processed in 35us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077142:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599335.077175:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599335.077181:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+7:10334:x1874433577902336:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077187:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077210:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787599335.077215:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+7:10334:x1874433577902336:12345-0@lo:104: Request processed in 35us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077220:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599335.077230:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599335.077234:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:10334:x1874433577902464:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077239:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077266:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787599335.077271:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:10334:x1874433577902464:12345-0@lo:104: Request processed in 36us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077276:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599335.077300:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599335.077306:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:10334:x1874433577902592:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077312:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077334:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787599335.077337:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:10334:x1874433577902592:12345-0@lo:104: Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077342:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599335.077351:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599335.077356:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:10334:x1874433577902720:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077361:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077379:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1787599335.077383:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:10334:x1874433577902720:12345-0@lo:104: Request processed in 28us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077388:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599335.077397:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599335.077402:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:10334:x1874433577902848:12345-0@lo:104: 00010000:00010000:3.0:1787599335.077407:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077433:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1787599335.077438:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:10334:x1874433577902848:12345-0@lo:104: Request processed in 37us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.077551:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787599335.077575:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787599335.077581:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077587:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200de00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.077592:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077600:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.077608:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.077614:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.077646:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077653:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.077670:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077676:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200de00/0x5d2988b0929cf282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077700:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787599335.077703:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077708:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d0c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.077711:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077718:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.077724:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.077728:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.077742:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077748:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.077765:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077771:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3821d0c00/0x5d2988b0929cf25f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077780:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787599335.077783:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077872:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.077876:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077882:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.077887:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.077892:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.077903:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077908:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.077912:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077917:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf24a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077925:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787599335.077928:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077933:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.077935:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077950:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.077956:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.077960:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.077973:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077978:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.077983:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077989:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497200/0x5d2988b0929cf219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.077998:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787599335.078000:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078006:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341496600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.078009:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078015:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.078021:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.078032:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.078046:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078051:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.078055:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078061:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf1fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078070:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787599335.078072:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078077:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.078079:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078085:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.078090:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.078096:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.078105:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078110:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.078120:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078127:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6400/0x5d2988b0929cf1ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078135:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787599335.078138:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078144:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.078146:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078153:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.078159:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.078165:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.078178:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078183:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.078187:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078192:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381325400/0x5d2988b0929cf1e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078199:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599335.078206:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078212:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.078215:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078221:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.078226:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.078230:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.078240:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078245:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.078248:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078253:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf1a9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078260:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599335.078263:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078268:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599335.078271:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078297:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599335.078303:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599335.078307:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599335.078330:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078334:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599335.078338:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078343:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381324400/0x5d2988b0929cf178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf17f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.078355:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599335.078356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599335.078358:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599335.078380:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577902976:0@lo:103: 00000100:00100000:3.0:1787599335.078420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599335.078588:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901824:0@lo:104: 00000100:00100000:2.0:1787599335.078598:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901952:0@lo:104: 00000100:00100000:2.0:1787599335.078604:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902080:0@lo:104: 00000100:00100000:2.0:1787599335.078611:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902208:0@lo:104: 00000100:00100000:2.0:1787599335.078618:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902336:0@lo:104: 00000100:00100000:2.0:1787599335.078624:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902464:0@lo:104: 00000100:00100000:2.0:1787599335.078631:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902592:0@lo:104: 00000100:00100000:2.0:1787599335.078638:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902720:0@lo:104: 00000100:00100000:2.0:1787599335.078645:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577902848:0@lo:104: 00010000:00010000:1.0:1787599335.081024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599335.081048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577903104:0@lo:103: 00000100:00100000:1.0:1787599335.081113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599335.081318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577902976 00000100:00100000:2.0:1787599335.081327:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577902976 00010000:00010000:2.0:1787599335.081363:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.081394:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903104 00000100:00100000:2.0:1787599335.081397:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903104 00010000:00010000:2.0:1787599335.081407:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 25 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.081419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599335.081425:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+25:3646:x1874433577902976:12345-0@lo:103: 00010000:00010000:2.0:1787599335.081436:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599335.081441:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081461:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081476:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf282 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081491:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599335.081524:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577902976:12345-0@lo:103: Request processed in 99us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599335.081530:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599335.081570:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599335.081576:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3647:x1874433577903104:12345-0@lo:103: 00010000:00010000:2.0:1787599335.081582:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599335.081599:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081607:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081616:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200d200/0x5d2988b0929cf266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf25f expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.081624:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599335.081646:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3647:x1874433577903104:12345-0@lo:103: Request processed in 70us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599335.081651:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599335.081983:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577902976:0@lo:103: 00000100:00100000:3.0:1787599335.081992:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903488:0@lo:103: 00000100:00100000:3.0:1787599335.082019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082042:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577904000:0@lo:103: 00000100:00100000:3.0:1787599335.082062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082100:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787599335.082107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903360:0@lo:103: 00000100:00100000:3.0:1787599335.082128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082139:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903872:0@lo:103: 00000100:00100000:3.0:1787599335.082156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082181:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577903232:0@lo:103: 00000100:00100000:3.0:1787599335.082202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082212:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577903744:0@lo:103: 00000100:00100000:3.0:1787599335.082232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.082255:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903488 00000100:00100000:3.0:1787599335.082259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903488 00010000:00010000:3.0:1787599335.082276:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 22 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082300:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904000 00000100:00100000:3.0:1787599335.082302:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904000 00010000:00010000:3.0:1787599335.082312:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903360 00000100:00100000:3.0:1787599335.082323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903360 00010000:00010000:3.0:1787599335.082330:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082337:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903872 00000100:00100000:3.0:1787599335.082339:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903872 00010000:00010000:3.0:1787599335.082346:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 25 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082353:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903232 00000100:00100000:3.0:1787599335.082360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903232 00010000:00010000:3.0:1787599335.082370:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903744 00000100:00100000:3.0:1787599335.082380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903744 00010000:00010000:3.0:1787599335.082386:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 27 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.082397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599335.082403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+27:3646:x1874433577903488:12345-0@lo:103: 00010000:00010000:3.0:1787599335.082410:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.082413:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.082422:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.082433:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf1fd expref: 27 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599335.082614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1787599335.082926:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599335.082959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+26:3646:x1874433577903488:12345-0@lo:103: Request processed in 556us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.082967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599335.082983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975104 00000100:00100000:3.0:1787599335.082987:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975104 00010000:00010000:3.0:1787599335.083002:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 10 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.083015:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599335.083031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+25:3646:x1874433577904000:12345-0@lo:103: 00010000:00010000:3.0:1787599335.083039:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.083043:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083051:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083062:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6c00/0x5d2988b0929cf17f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf178 expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083070:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599335.083093:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577904000:12345-0@lo:103: Request processed in 65us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.083099:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599335.083110:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599335.083116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3646:x1874433577903360:12345-0@lo:103: 00010000:00010000:3.0:1787599335.083122:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.083127:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083134:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083143:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf219 expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083150:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599335.083172:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3646:x1874433577903360:12345-0@lo:103: Request processed in 57us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.083188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599335.083201:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599335.083206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3646:x1874433577903872:12345-0@lo:103: 00010000:00010000:3.0:1787599335.083213:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.083218:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083225:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083234:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf1a2 expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083242:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599335.083263:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3646:x1874433577903872:12345-0@lo:103: Request processed in 58us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.083268:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599335.083292:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599335.083299:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:3648:x1874433577903232:12345-0@lo:103: 00010000:00010000:3.0:1787599335.083305:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.083309:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083317:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083327:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d0a00/0x5d2988b0929cf24a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf243 expref: 19 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083345:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599335.083371:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:3648:x1874433577903232:12345-0@lo:103: Request processed in 73us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.083377:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599335.083387:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599335.083392:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:3648:x1874433577903744:12345-0@lo:103: 00010000:00010000:3.0:1787599335.083398:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599335.083402:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 17 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083409:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 17 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083418:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1200/0x5d2988b0929cf1e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf1e1 expref: 17 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599335.083426:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599335.083544:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903360:0@lo:103: 00000100:00100000:0.0:1787599335.083552:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903872:0@lo:103: 00000100:00100000:0.0:1787599335.083568:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577903488:0@lo:103: 00000100:00100000:0.0:1787599335.083574:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577904000:0@lo:103: 00000100:00100000:3.0:1787599335.083773:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3648:x1874433577903744:12345-0@lo:103: Request processed in 51us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.083781:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599335.083942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1787599335.083953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558975104:12345-192.168.202.1@tcp:103: 00010000:00010000:0.0:1787599335.083961:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599335.083967:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 10 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599335.083977:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 10 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599335.083989:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599335.084031:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558975104:12345-192.168.202.1@tcp:103: Request processed in 81us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599335.084037:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1787599335.085131:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577903232:0@lo:103: 00000100:00100000:3.0:1787599335.085143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577903744:0@lo:103: 00010000:00010000:2.0:1787599335.086325:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200d400/0x5d2988b0929cf2a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb991 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.086342:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901568:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599335.086352:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1874433577901696:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599335.086390:0:10334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599335.086603:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577903104:0@lo:103: 00000100:00100000:1.0:1787599335.086613:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577903616:0@lo:103: 00000100:00100000:1.0:1787599335.086668:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599335.086754:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577903616 00000100:00100000:2.0:1787599335.086761:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577903616 00010000:00010000:2.0:1787599335.086829:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 16 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599335.086859:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599335.086867:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:3647:x1874433577903616:12345-0@lo:103: 00010000:00010000:2.0:1787599335.086880:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599335.086895:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 16 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.086905:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 16 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.086920:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324000/0x5d2988b0929cf1f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf1ef expref: 16 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599335.086931:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599335.086967:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:3647:x1874433577903616:12345-0@lo:103: Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599335.086974:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599335.087149:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577903616:0@lo:103: 00000100:00100000:0.0:1787599335.087322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599335.087381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975232 00000100:00100000:1.0:1787599335.087385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975232 00010000:00010000:1.0:1787599335.087402:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599335.087427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1787599335.087434:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:2403:x1874433558975232:12345-192.168.202.1@tcp:103: 00010000:00010000:1.0:1787599335.087450:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599335.087462:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087470:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087482:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c400/0x5d2988b0929cf29e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb98a expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087495:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087503:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087516:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087523:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087530:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087537:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087542:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599335.087545:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087554:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087579:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599335.087588:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599335.087622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:2403:x1874433558975232:12345-192.168.202.1@tcp:103: Request processed in 189us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599335.087628:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00010000:00010000:0.0:1787599335.087898:0:10334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599335.087906:0:10334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599335.087911:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7000/0x5d2988b0929cf2e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599335.366648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599335.366687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599335.366726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599335.366749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599335.366816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599335.366846:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975872 00000100:00100000:3.0:1787599335.366856:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975872 00000100:00100000:3.0:1787599335.366912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975744 00000100:00100000:3.0:1787599335.366915:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975744 00000100:00100000:3.0:1787599335.366941:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1787599335.366952:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975872:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1787599335.367024:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975872:12345-192.168.202.1@tcp:400: Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.367032:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1787599335.367048:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599335.367055:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975744:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1787599335.367078:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975744:12345-192.168.202.1@tcp:400: Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.367084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1787599335.367451:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975360 00000100:00100000:0.0:1787599335.367457:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975360 00000100:00100000:0.0:1787599335.367500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:0.0:1787599335.367518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:2406:x1874433558975360:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1787599335.367551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:2406:x1874433558975360:12345-192.168.202.1@tcp:400: Request processed in 35us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599335.367558:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:0.0:1787599335.367594:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975616 00000100:00100000:0.0:1787599335.367599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975616 00000100:00100000:0.0:1787599335.367628:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558975488 00000100:00100000:0.0:1787599335.367631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558975488 00000100:00100000:0.0:1787599335.367650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1787599335.367657:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975616:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1787599335.367688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558975616:12345-192.168.202.1@tcp:400: Request processed in 31us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599335.367693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1787599335.367704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1787599335.367710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558975488:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1787599335.367729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558975488:12345-192.168.202.1@tcp:400: Request processed in 21us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599335.367735:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00080000:0.0:1787599335.367749:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599335.367753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599335.367755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599335.367757:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787599335.654243:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599336.199713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599336.199947:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976000 00000100:00100000:2.0:1787599336.199961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976000 00000100:00100000:2.0:1787599336.200024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:2.0:1787599336.200033:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:6177:x1874433558976000:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1787599336.200051:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599336.200069:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf2eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.200091:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba01 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.200099:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba01 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.200106:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6800, rc 0) 00000100:00100000:2.0:1787599336.200160:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976000:12345-192.168.202.1@tcp:101: Request processed in 127us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.200183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1787599336.204319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599336.204448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976128 00000100:00100000:3.0:1787599336.204458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976128 00000100:00100000:3.0:1787599336.204519:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1787599336.204526:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976128:12345-192.168.202.1@tcp:501: 00000100:00100000:3.0:1787599336.204661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976128:12345-192.168.202.1@tcp:501: Request processed in 136us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.204667:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1787599336.206654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599336.206748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976256 00000100:00100000:0.0:1787599336.206756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976256 00000100:00100000:0.0:1787599336.206821:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:0.0:1787599336.206843:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976256:12345-192.168.202.1@tcp:503: 00000100:00100000:0.0:1787599336.206963:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976256:12345-192.168.202.1@tcp:503: Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.206969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:0.0:1787599336.209556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599336.209647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976384 00000100:00100000:2.0:1787599336.209657:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976384 00000100:00100000:2.0:1787599336.209716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:2.0:1787599336.209727:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6654:x1874433558976384:12345-192.168.202.1@tcp:502: 00000100:00100000:2.0:1787599336.209921:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6654:x1874433558976384:12345-192.168.202.1@tcp:502: Request processed in 194us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.209930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1787599336.213113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599336.213251:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976512 00000100:00100000:3.0:1787599336.213261:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976512 00000100:00100000:3.0:1787599336.213341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:3.0:1787599336.213366:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6654:x1874433558976512:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599336.213535:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6654:x1874433558976512:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 171us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.213541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:3.0:1787599336.228743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599336.235279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976640 00000100:00100000:0.0:1787599336.235296:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976640 00000100:00100000:0.0:1787599336.235384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:0.0:1787599336.235395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558976640:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599336.235412:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599336.235617:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381325800/0x5d2988b0929cf2f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba08 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.235651:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381325800/0x5d2988b0929cf2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba08 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.235664:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381325800/0x5d2988b0929cf2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba08 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.235674:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325800, rc 0) 00000100:00100000:0.0:1787599336.235744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558976640:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 352us (7182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.235749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:0.0:1787599336.247904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599336.248427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976768 00000100:00100000:2.0:1787599336.248440:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976768 00000100:00100000:2.0:1787599336.248507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:2.0:1787599336.248518:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558976768:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.249219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558976768:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 695us (1317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599336.249232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 10000000:01000000:2.0:1787599336.296495:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787599336.296504:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37f896800 from 48 10000000:01000000:2.0:1787599336.296511:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599336.296564:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.296576:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.296588:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.296649:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904128:0@lo:101: 00000100:00100000:2.0:1787599336.296725:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.296848:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599336.298626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904128 00000100:00100000:3.0:1787599336.298641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904128 00000100:00100000:3.0:1787599336.298706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787599336.298716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+15:6517:x1874433577904128:12345-0@lo:101: 00010000:00010000:3.0:1787599336.298730:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599336.298746:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200dc00/0x5d2988b0929cf300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf2f9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.298787:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200dc00/0x5d2988b0929cf300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf2f9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.298816:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200dc00/0x5d2988b0929cf300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf2f9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.298825:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200dc00, rc 0) 00000100:00100000:3.0:1787599336.298931:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904128:12345-0@lo:101: Request processed in 216us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.298937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787599336.299237:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904128:0@lo:101: 00010000:00010000:0.0:1787599336.299255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.299293:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599336.299372:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904256:0@lo:501: 00000100:00100000:0.0:1787599336.299410:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.299448:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.300573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904256 00000100:00100000:2.0:1787599336.300584:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904256 00000100:00100000:2.0:1787599336.300653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787599336.300664:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904256:12345-0@lo:501: 00000100:00100000:2.0:1787599336.301085:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904256:12345-0@lo:501: Request processed in 422us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.301093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787599336.301290:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904256:0@lo:501: 00000100:00100000:0.0:1787599336.301335:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904384:0@lo:503: 00000100:00100000:0.0:1787599336.301391:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.301429:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.301665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904384 00000100:00100000:1.0:1787599336.301672:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904384 00000100:00100000:1.0:1787599336.301709:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787599336.301717:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904384:12345-0@lo:503: 00000100:00100000:1.0:1787599336.301853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904384:12345-0@lo:503: Request processed in 135us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.301860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787599336.306448:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904384:0@lo:503: 00000100:00100000:0.0:1787599336.308037:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10351:1874433577904512:0@lo:502: 00000100:00100000:0.0:1787599336.308119:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.308175:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599336.309158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904512 00000100:00100000:3.0:1787599336.309176:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904512 00000100:00100000:3.0:1787599336.309245:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787599336.309255:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:10351:x1874433577904512:12345-0@lo:502: 00000100:00100000:3.0:1787599336.309441:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:10351:x1874433577904512:12345-0@lo:502: Request processed in 187us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.309456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787599336.310101:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10351:1874433577904512:0@lo:502: 00000100:00100000:0.0:1787599336.310178:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10351:1874433577904640:0@lo:502: 00000100:00100000:0.0:1787599336.310225:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.310264:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.310566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904640 00000100:00100000:2.0:1787599336.310573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904640 00000100:00100000:2.0:1787599336.310629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787599336.310638:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:10351:x1874433577904640:12345-0@lo:502: 00000100:00100000:2.0:1787599336.310752:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:10351:x1874433577904640:12345-0@lo:502: Request processed in 116us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.310760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787599336.311386:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10351:1874433577904640:0@lo:502: 00000040:00080000:0.0:1787599336.311414:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787599336.312468:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787599336.312493:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599336.312504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.312516:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599336.312525:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787599336.312541:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787599336.312544:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599336.312577:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.312585:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.312595:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.312629:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904768:0@lo:101: 00000100:00100000:2.0:1787599336.312697:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.312738:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599336.313164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904768 00000100:00100000:3.0:1787599336.313183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904768 00000100:00100000:3.0:1787599336.313236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787599336.313245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+16:6517:x1874433577904768:12345-0@lo:101: 00010000:00010000:3.0:1787599336.313258:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599336.313283:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200de00/0x5d2988b0929cf30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf307 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.313307:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200de00/0x5d2988b0929cf30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf307 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.313317:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200de00/0x5d2988b0929cf30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf307 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.313326:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200de00, rc 0) 00000100:00100000:3.0:1787599336.313386:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577904768:12345-0@lo:101: Request processed in 142us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.313393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787599336.314714:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904768:0@lo:101: 00010000:00010000:2.0:1787599336.314738:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.314749:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.314864:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904896:0@lo:501: 00000100:00100000:2.0:1787599336.314913:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.314950:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.315595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577904896 00000100:00100000:0.0:1787599336.315604:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577904896 00000100:00100000:0.0:1787599336.315677:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787599336.315686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577904896:12345-0@lo:501: 00000100:00100000:0.0:1787599336.315868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577904896:12345-0@lo:501: Request processed in 182us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.315875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787599336.316840:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577904896:0@lo:501: 00000100:00100000:2.0:1787599336.316886:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905024:0@lo:503: 00000100:00100000:2.0:1787599336.316941:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.316975:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.317071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905024 00000100:00100000:0.0:1787599336.317077:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905024 00000100:00100000:0.0:1787599336.317127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787599336.317136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577905024:12345-0@lo:503: 00000100:00100000:0.0:1787599336.317241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577905024:12345-0@lo:503: Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.317248:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787599336.318250:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905024:0@lo:503: 00000100:00100000:1.0:1787599336.319543:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10352:1874433577905152:0@lo:502: 00000100:00100000:1.0:1787599336.319622:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.319667:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.319833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905152 00000100:00100000:0.0:1787599336.319841:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905152 00000100:00100000:0.0:1787599336.319933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787599336.319945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:10352:x1874433577905152:12345-0@lo:502: 00000100:00100000:0.0:1787599336.320070:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:10352:x1874433577905152:12345-0@lo:502: Request processed in 127us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.320079:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787599336.320160:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10352:1874433577905152:0@lo:502: 00000020:01000000:1.0:1787599336.320189:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599336.320197:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599336.320200:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787599336.320207:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787599336.320241:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10352:1874433577905280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.320463:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.327498:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.327739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905280 00000100:00100000:2.0:1787599336.327750:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905280 00000100:00100000:2.0:1787599336.327827:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787599336.327837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:10352:x1874433577905280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.327999:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:10352:x1874433577905280:12345-0@lo:502:llog_process_th.0 Request processed in 163us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.328007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787599336.328182:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10352:1874433577905280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599336.328219:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599336.328240:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599336.328243:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787599336.328252:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787599336.328824:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787599336.328844:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787599336.328855:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.328867:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599336.328876:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787599336.328879:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3778e6800 from 48 10000000:01000000:2.0:1787599336.328882:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599336.328916:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.328925:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.328934:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.328955:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.329023:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.329056:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.329469:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905408 00000100:00100000:1.0:1787599336.329477:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905408 00000100:00100000:1.0:1787599336.329512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787599336.329520:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+17:6517:x1874433577905408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.329533:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599336.329547:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341497c00/0x5d2988b0929cf31c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf315 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.329570:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341497c00/0x5d2988b0929cf31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf315 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.329580:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341497c00/0x5d2988b0929cf31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf315 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.329589:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341497c00, rc 0) 00000100:00100000:1.0:1787599336.329631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577905408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.329637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787599336.329737:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599336.329751:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.329761:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.330012:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.330041:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.330101:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.330171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905536 00000100:00100000:0.0:1787599336.330176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905536 00000100:00100000:1.0:1787599336.330246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787599336.330254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577905536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.336119:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577905536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5857us (6068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.336133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787599336.336322:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.336375:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.336423:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.336466:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.336623:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905664 00000100:00100000:1.0:1787599336.336629:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905664 00000100:00100000:1.0:1787599336.336661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787599336.336669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577905664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.336760:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577905664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.336767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787599336.336930:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577905664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.341689:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10353:1874433577905792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599336.341780:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.341863:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.342064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905792 00000100:00100000:1.0:1787599336.342073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905792 00000100:00100000:1.0:1787599336.342125:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787599336.342136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:10353:x1874433577905792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.342292:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:10353:x1874433577905792:12345-0@lo:502:llog_process_th.0 Request processed in 157us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.342299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787599336.342401:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10353:1874433577905792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.342451:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10353:1874433577905920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.342485:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.342515:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370789cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.343049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577905920 00000100:00100000:1.0:1787599336.343055:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577905920 00000100:00100000:1.0:1787599336.343078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787599336.343084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:10353:x1874433577905920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.343161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:10353:x1874433577905920:12345-0@lo:502:llog_process_th.0 Request processed in 75us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.343168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787599336.343277:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10353:1874433577905920:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787599336.343313:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787599336.343562:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787599336.343582:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787599336.343592:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.343603:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599336.343619:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787599336.343621:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787599336.343624:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787599336.343648:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.343655:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.343663:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.343679:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.343712:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.343744:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.343819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906048 00000100:00100000:2.0:1787599336.343829:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906048 00000100:00100000:2.0:1787599336.343853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787599336.343860:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+18:6517:x1874433577906048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599336.343869:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599336.343881:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf32a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf323 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.343903:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf323 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.343914:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf323 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.343922:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7a00, rc 0) 00000100:00100000:2.0:1787599336.343977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.343984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787599336.344168:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.344181:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.344190:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.344240:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.344277:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.344310:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.344430:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906176 00000100:00100000:2.0:1787599336.344435:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906176 00000100:00100000:2.0:1787599336.344467:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787599336.344474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.344588:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.344595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787599336.344694:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.344721:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.344766:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.344816:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.344942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906304 00000100:00100000:0.0:1787599336.344947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906304 00000100:00100000:0.0:1787599336.344963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787599336.344969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599336.345045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.345051:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787599336.345155:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.345780:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10354:1874433577906432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.345853:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.345879:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b366913a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.346053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906432 00000100:00100000:0.0:1787599336.346066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906432 00000100:00100000:0.0:1787599336.346094:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787599336.346102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:10354:x1874433577906432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599336.346197:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:10354:x1874433577906432:12345-0@lo:502:llog_process_th.0 Request processed in 95us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.346205:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787599336.346279:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10354:1874433577906432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599336.346318:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599336.346327:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599336.346330:0:10354:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787599336.346334:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787599336.346356:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10354:1874433577906560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.346393:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.346422:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.346503:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906560 00000100:00100000:1.0:1787599336.346508:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906560 00000100:00100000:1.0:1787599336.346538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787599336.346544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:10354:x1874433577906560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.346615:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:10354:x1874433577906560:12345-0@lo:502:llog_process_th.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.346622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787599336.346682:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10354:1874433577906560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599336.346699:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599336.346704:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599336.346706:0:10354:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787599336.346709:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787599336.346936:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787599336.346955:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787599336.346964:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.346974:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599336.346983:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599336.346985:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3812cf000 from 48 10000000:01000000:1.0:1787599336.346988:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599336.347015:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.347022:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.347032:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.347053:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.347081:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.347102:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.347145:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906688 00000100:00100000:2.0:1787599336.347149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906688 00000100:00100000:2.0:1787599336.347168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787599336.347174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:6517:x1874433577906688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599336.347182:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599336.347194:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf331 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.347211:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf331 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.347220:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf331 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.347228:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6600, rc 0) 00000100:00100000:2.0:1787599336.347276:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577906688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.347298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787599336.347413:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.347425:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.347434:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.347483:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.347507:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.347529:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787599336.347600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906816 00000100:00100000:3.0:1787599336.347605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906816 00000100:00100000:3.0:1787599336.347629:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787599336.347637:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577906816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.347755:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577906816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.347770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787599336.347945:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.347969:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.348006:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.348025:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.348090:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577906944 00000100:00100000:0.0:1787599336.348095:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577906944 00000100:00100000:0.0:1787599336.348117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787599336.348125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577906944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599336.348212:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577906944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.348219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787599336.348304:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577906944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.348740:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10355:1874433577907072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.348779:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.348996:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.349075:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907072 00000100:00100000:0.0:1787599336.349080:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907072 00000100:00100000:0.0:1787599336.349113:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787599336.349120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:10355:x1874433577907072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599336.349211:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:10355:x1874433577907072:12345-0@lo:502:llog_process_th.0 Request processed in 91us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.349218:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787599336.349380:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10355:1874433577907072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.349420:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10355:1874433577907200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.349457:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.349480:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599336.349539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907200 00000100:00100000:3.0:1787599336.349543:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907200 00000100:00100000:3.0:1787599336.349576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787599336.349584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:10355:x1874433577907200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599336.349658:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:10355:x1874433577907200:12345-0@lo:502:llog_process_th.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.349665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787599336.349969:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10355:1874433577907200:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787599336.349990:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787599336.353430:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787599336.353486:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599336.353501:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.353514:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599336.353527:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787599336.353531:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787599336.353534:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599336.353580:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.353588:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.353600:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.353625:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.353696:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.353748:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.353832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907328 00000100:00100000:0.0:1787599336.353840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907328 00000100:00100000:0.0:1787599336.353891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787599336.353902:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577907328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599336.353915:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599336.353928:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381324a00/0x5d2988b0929cf346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf33f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.353971:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324a00/0x5d2988b0929cf346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf33f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.353981:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381324a00/0x5d2988b0929cf346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf33f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.353991:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324a00, rc 0) 00000100:00100000:0.0:1787599336.354032:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.354039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787599336.354208:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599336.354224:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599336.354243:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599336.354313:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.354340:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.354368:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.354411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907456 00000100:00100000:0.0:1787599336.354416:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907456 00000100:00100000:0.0:1787599336.354449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787599336.354457:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599336.354574:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.354582:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787599336.354701:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.354729:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599336.354772:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.354820:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3432aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.356012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907584 00000100:00100000:1.0:1787599336.356025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907584 00000100:00100000:1.0:1787599336.356077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787599336.356087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.356210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.356217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787599336.356362:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.358203:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10356:1874433577907712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.358293:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.358340:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599336.358390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907712 00000100:00100000:2.0:1787599336.358397:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907712 00000100:00100000:2.0:1787599336.358446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787599336.358456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10356:x1874433577907712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599336.358585:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10356:x1874433577907712:12345-0@lo:502:llog_process_th.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.358593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787599336.358676:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10356:1874433577907712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599336.358705:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599336.358714:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599336.358716:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787599336.358722:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787599336.358744:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10356:1874433577907840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599336.358779:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.358844:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.359151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907840 00000100:00100000:1.0:1787599336.359156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907840 00000100:00100000:1.0:1787599336.359182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787599336.359189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10356:x1874433577907840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.359263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10356:x1874433577907840:12345-0@lo:502:llog_process_th.0 Request processed in 74us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.359283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787599336.359362:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10356:1874433577907840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599336.359383:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599336.359389:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599336.359391:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787599336.359396:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1787599336.365487:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1787599336.365525:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787599336.365536:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.365573:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599336.365584:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599336.365587:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3707b1000 from 48 10000000:01000000:1.0:1787599336.365590:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599336.365628:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.365636:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.365648:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.365674:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.365741:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.365808:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.365863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577907968 00000100:00100000:0.0:1787599336.365878:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577907968 00000100:00100000:0.0:1787599336.365934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787599336.365944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577907968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599336.365957:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599336.365970:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381325a00/0x5d2988b0929cf354 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf34d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.365994:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381325a00/0x5d2988b0929cf354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf34d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.366004:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381325a00/0x5d2988b0929cf354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf34d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599336.366014:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325a00, rc 0) 00000100:00100000:0.0:1787599336.366055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577907968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.366062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787599336.366447:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577907968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599336.366462:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.366472:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599336.366586:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.366616:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.366637:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.366772:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908096 00000100:00100000:1.0:1787599336.366777:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908096 00000100:00100000:1.0:1787599336.366834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787599336.366842:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577908096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.366957:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577908096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.366964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787599336.367189:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.367237:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.367293:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.367323:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.367363:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908224 00000100:00100000:1.0:1787599336.367368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908224 00000100:00100000:1.0:1787599336.367398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787599336.367412:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577908224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.367511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577908224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.367518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787599336.367591:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599336.368213:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10357:1874433577908352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599336.368259:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.368301:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421de900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.368347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908352 00000100:00100000:1.0:1787599336.368353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908352 00000100:00100000:1.0:1787599336.368388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787599336.368395:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10357:x1874433577908352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.368508:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10357:x1874433577908352:12345-0@lo:502:llog_process_th.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.368515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787599336.368591:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10357:1874433577908352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599336.368631:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10357:1874433577908480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599336.368666:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.368691:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781c5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599336.368921:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908480 00000100:00100000:0.0:1787599336.368926:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908480 00000100:00100000:0.0:1787599336.368963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787599336.368971:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10357:x1874433577908480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599336.369041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10357:x1874433577908480:12345-0@lo:502:llog_process_th.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.369047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787599336.369149:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10357:1874433577908480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787599336.369172:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787599336.369224:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787599336.369244:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599336.369253:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.369264:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599336.369282:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787599336.369285:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787599336.369287:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599336.369313:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.369320:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599336.369338:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599336.369352:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599336.369380:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.369400:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.369663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908608 00000100:00100000:1.0:1787599336.369669:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908608 00000100:00100000:1.0:1787599336.369706:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787599336.369715:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577908608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.369724:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599336.369737:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341496000/0x5d2988b0929cf362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf35b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.369758:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341496000/0x5d2988b0929cf362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf35b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.369768:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341496000/0x5d2988b0929cf362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf35b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.369778:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341496000, rc 0) 00000100:00100000:1.0:1787599336.369839:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577908608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.369852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787599336.369890:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.369902:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.369912:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.369962:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.369987:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.370006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908736 00000100:00100000:1.0:1787599336.370009:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908736 00000100:00100000:1.0:1787599336.370026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787599336.370031:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577908736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.370115:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577908736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.370121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787599336.370145:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.370157:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.370181:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.370216:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.370234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908864 00000100:00100000:1.0:1787599336.370237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908864 00000100:00100000:1.0:1787599336.370255:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787599336.370261:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577908864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.370371:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577908864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.370377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787599336.370404:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.370416:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577908864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.370612:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10358:1874433577908992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.370643:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.370660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577908992 00000100:00100000:1.0:1787599336.370663:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577908992 00000100:00100000:1.0:1787599336.370680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787599336.370684:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10358:x1874433577908992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.370747:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10358:x1874433577908992:12345-0@lo:502:llog_process_th.0 Request processed in 61us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.370753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787599336.370776:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.370786:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10358:1874433577908992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599336.370862:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599336.370870:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599336.370873:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787599336.370881:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787599336.370900:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10358:1874433577909120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.370932:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.370951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909120 00000100:00100000:1.0:1787599336.370954:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909120 00000100:00100000:1.0:1787599336.370971:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787599336.370977:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10358:x1874433577909120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599336.371039:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10358:x1874433577909120:12345-0@lo:502:llog_process_th.0 Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.371046:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787599336.371078:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.371090:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10358:1874433577909120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599336.371107:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599336.371112:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599336.371113:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787599336.371119:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787599336.371165:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787599336.371179:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787599336.371187:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371197:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599336.371207:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787599336.371209:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b34dcf99b8 from 1 10000000:01000000:1.0:1787599336.371212:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599336.371231:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371238:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371246:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.371280:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577909248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.371307:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.371322:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.371335:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909248 00000100:00100000:1.0:1787599336.371338:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909248 00000100:00100000:1.0:1787599336.371355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787599336.371360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577909248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.371368:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599336.371379:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b341497200/0x5d2988b0929cf370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf369 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371395:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b341497200/0x5d2988b0929cf370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf369 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371403:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b341497200/0x5d2988b0929cf370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf369 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371411:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b341497200, rc 0) 00000100:00100000:1.0:1787599336.371438:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577909248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.371444:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787599336.371473:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577909248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599336.371484:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371492:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599336.371535:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577909376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.371557:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.371568:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24331b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599336.371578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909376 00000100:00100000:1.0:1787599336.371581:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909376 00000100:00100000:1.0:1787599336.371596:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787599336.371602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577909376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599336.371649:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577909376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (91us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599336.371655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787599336.371678:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577909376:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787599336.371694:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787599336.371699:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599336.371706:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599336.485954:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577909504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599336.486037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.487512:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577909760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.487572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.487621:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577910272:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.487647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.487668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577910784:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.487692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.487725:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577911296:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.487749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.487773:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599336.487778:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577909888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.489108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.489389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577910400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.489419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.489438:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.489458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.489495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909760 00000100:00100000:2.0:1787599336.489502:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909760 00000100:00100000:2.0:1787599336.489554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787599336.489563:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.489612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577909760:12345-0@lo:400:kworker.0 Request processed in 50us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.489619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787599336.489656:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910272 00000100:00100000:2.0:1787599336.489661:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910272 00000100:00100000:2.0:1787599336.489688:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599336.489694:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577910272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.489727:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577910272:12345-0@lo:400:kworker.0 Request processed in 32us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.489732:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599336.489751:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910784 00000100:00100000:2.0:1787599336.489755:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910784 00000100:00100000:2.0:1787599336.489784:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911296 00000100:00100000:2.0:1787599336.489787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911296 00000100:00100000:2.0:1787599336.491023:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599336.491033:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.491086:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577910784:12345-0@lo:400:kworker.0 Request processed in 56us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.491092:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599336.491108:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599336.491114:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577911296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.491934:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577911296:12345-0@lo:400:kworker.0 Request processed in 816us (4180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.492010:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599336.492047:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909888 00000100:00100000:2.0:1787599336.492053:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909888 00000100:00100000:2.0:1787599336.492079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910400 00000100:00100000:2.0:1787599336.492082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910400 00000100:00100000:2.0:1787599336.492095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910912 00000100:00100000:2.0:1787599336.492098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910912 00000100:00100000:2.0:1787599336.492110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599336.492116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577909888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492220:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577909888:12345-0@lo:400:kworker.0 Request processed in 104us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.492227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599336.492239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599336.492245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577910400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577910400:12345-0@lo:400:kworker.0 Request processed in 40us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.492292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599336.492302:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599336.492315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577910912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492344:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577910912:12345-0@lo:400:kworker.0 Request processed in 30us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.492350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787599336.492358:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577909632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599336.492391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599336.492409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577909888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492421:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577910400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492430:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577909760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.492449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577910272:0@lo:400:kworker.0 00010000:00080000:2.0:1787599336.492461:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ae300 x1874433577910784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599336.492471:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577910784:0@lo:400:kworker.0 00010000:00080000:2.0:1787599336.492481:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ac000 x1874433577911296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599336.492489:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577911296:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.494339:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577910144:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.494389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.494410:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577910656:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.494434:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.494452:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577911168:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.494472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.496155:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787599336.496235:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577910016:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.496297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.496332:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577910528:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.496356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.496374:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577911040:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.496395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599336.496433:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910144 00000100:00100000:0.0:1787599336.496439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910144 00000100:00100000:0.0:1787599336.496472:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910528 00000100:00100000:0.0:1787599336.496474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910528 00000100:00100000:0.0:1787599336.496486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911040 00000100:00100000:0.0:1787599336.496487:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911040 00000100:00100000:1.0:1787599336.496595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910016 00000100:00100000:1.0:1787599336.496599:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910016 00000100:00100000:1.0:1787599336.496627:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599336.496636:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577910016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599336.496690:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577910016:12345-0@lo:400:kworker.0 Request processed in 55us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.496696:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599336.496924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599336.496934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.496968:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577910144:12345-0@lo:400:kworker.0 Request processed in 35us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.496984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599336.496999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599336.497005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577910528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.497038:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577910528:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.497043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599336.497052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787599336.497058:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577911040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.497077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577911040:12345-0@lo:400:kworker.0 Request processed in 20us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.497082:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787599336.497096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599336.497099:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599336.497102:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599336.497105:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599336.497114:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577910656 00000100:00100000:0.0:1787599336.497116:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577910656 00000100:00100000:0.0:1787599336.497149:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911168 00000100:00100000:0.0:1787599336.497152:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911168 00000100:00100000:0.0:1787599336.497166:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787599336.497259:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599336.497261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599336.497928:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577910656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.497972:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577910656:12345-0@lo:400:kworker.0 Request processed in 799us (3537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.497980:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787599336.497997:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599336.498004:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577911168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.498048:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577911168:12345-0@lo:400:kworker.0 Request processed in 45us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.498054:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599336.498114:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577910016:0@lo:400:kworker.0 00010000:00080000:0.0:1787599336.498128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435adf80 x1874433577910528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599336.498138:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577910528:0@lo:400:kworker.0 00010000:00080000:0.0:1787599336.498149:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ae680 x1874433577911040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599336.498157:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577911040:0@lo:400:kworker.0 00000100:00100000:0.0:1787599336.498168:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577910144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599336.498437:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909504 00000100:00100000:2.0:1787599336.498437:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577909632 00000100:00100000:3.0:1787599336.498443:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909504 00000100:00100000:2.0:1787599336.498443:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577909632 00000100:00100000:2.0:1787599336.498488:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599336.498496:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577909632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599336.498518:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599336.498555:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577909632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.498673:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599336.498744:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599336.498751:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577909504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599336.498776:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787599336.498888:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ad880 x1874433577910656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599336.498894:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577909504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (12858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599336.498898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577910656:0@lo:400:kworker.0 00000100:00100000:2.0:1787599336.498900:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787599336.498909:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ad500 x1874433577911168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599336.498918:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577911168:0@lo:400:kworker.0 00010000:00080000:0.0:1787599336.498947:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b1880 x1874433577909632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599336.498962:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577909632:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787599336.499333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87c700 x1874433577909504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599336.499346:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577909504:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787599336.681966:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599336.997192:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599336.997228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577911424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599336.997309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599336.997437:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911424 00000100:00100000:3.0:1787599336.997445:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911424 00000100:00100000:3.0:1787599336.997500:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599336.997510:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577911424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599336.997539:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599336.997589:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577911424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599336.997596:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787599336.997635:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87d500 x1874433577911424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599336.997654:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577911424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599336.997922:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599336.997932:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577911552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599336.997964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599336.998105:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911552 00000100:00100000:1.0:1787599336.998110:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911552 00000100:00100000:1.0:1787599336.998146:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599336.998154:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577911552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599336.998165:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599336.998202:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577911552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.998208:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787599336.998236:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b47480 x1874433577911552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599336.998250:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577911552:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1787599337.243445:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff55f227d0 20000000:00000080:2.0:1787599337.243463:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b243073c00 uarg=0000000000000000 20000000:01000000:2.0:1787599337.243504:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787599337.243509:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787599337.243513:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787599337.244406:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787599337.244558:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787599337.248616:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787599337.248655:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787599337.248690:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787599337.248706:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599337.248726:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.248745:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.248753:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.248762:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.248988:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.248999:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249006:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249051:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249067:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 9 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.249083:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911680:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599337.249324:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249333:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 23 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.249344:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911808:0@lo:104: 00000100:00100000:2.0:1787599337.249388:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599337.249687:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249697:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 23 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.249721:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911936:0@lo:104: 00000100:00100000:2.0:1787599337.249751:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599337.249812:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249821:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 23 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.249829:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577912064:0@lo:104: 00010000:00010000:2.0:1787599337.249856:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.249865:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 23 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.249873:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577912192:0@lo:104: 00000100:00100000:2.0:1787599337.249891:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599337.249952:0:8450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787599337.249970:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599337.250145:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599337.250157:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911808 00000100:00100000:2.0:1787599337.250163:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911808 00000100:00100000:2.0:1787599337.250201:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577911936 00000100:00100000:2.0:1787599337.250204:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577911936 00000100:00100000:2.0:1787599337.250214:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912064 00000100:00100000:2.0:1787599337.250217:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912064 00000100:00100000:2.0:1787599337.250226:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912192 00000100:00100000:2.0:1787599337.250228:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912192 00000100:00100000:2.0:1787599337.250240:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599337.250271:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:10395:x1874433577911808:12345-0@lo:104: 00010000:00010000:2.0:1787599337.250285:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.250341:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599337.250348:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:10395:x1874433577911808:12345-0@lo:104: Request processed in 92us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.250354:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599337.250373:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599337.250379:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2432fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:10395:x1874433577911936:12345-0@lo:104: 00010000:00010000:2.0:1787599337.250387:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.250551:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599337.250558:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2432fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:10395:x1874433577911936:12345-0@lo:104: Request processed in 179us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.250565:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599337.250596:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599337.250603:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:10395:x1874433577912064:12345-0@lo:104: 00010000:00010000:2.0:1787599337.250611:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.250639:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787599337.250644:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:10395:x1874433577912064:12345-0@lo:104: Request processed in 42us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.250650:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599337.250661:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599337.250675:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:10395:x1874433577912192:12345-0@lo:104: 00010000:00010000:2.0:1787599337.250683:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.250711:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787599337.250716:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:10395:x1874433577912192:12345-0@lo:104: Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.250721:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599337.250764:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911808:0@lo:104: 00000100:00100000:2.0:1787599337.250773:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911936:0@lo:104: 00000100:00100000:2.0:1787599337.250880:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577912064:0@lo:104: 00000100:00100000:2.0:1787599337.250888:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577912192:0@lo:104: 00010000:00010000:2.0:1787599337.250924:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787599337.250930:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251074:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599337.251079:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251089:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599337.251097:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599337.251104:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599337.251137:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251150:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599337.251171:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7200/0x5d2988b0929cf194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf19b expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251192:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599337.251195:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251201:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d1600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599337.251204:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251211:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599337.251217:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599337.251222:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599337.251236:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.251242:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599337.251650:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787599337.251689:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577912320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599337.251724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599337.251769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912320 00000100:00100000:1.0:1787599337.251774:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912320 00010000:00010000:1.0:1787599337.251820:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599337.251842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599337.251848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577912320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599337.251857:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599337.251862:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.251882:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.251896:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf19b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf194 expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.251908:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599337.251943:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3648:x1874433577912320:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599337.251949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599337.251978:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577912320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599337.255873:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599337.255884:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.255893:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599337.255898:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.255908:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599337.255915:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599337.255921:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599337.255971:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.256402:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787599337.257233:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577912448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599337.257319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599337.257383:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599337.257391:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577912576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599337.257413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599337.257542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912448 00000100:00100000:3.0:1787599337.257549:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912448 00010000:00010000:3.0:1787599337.257576:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 23 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599337.257601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912576 00000100:00100000:3.0:1787599337.257615:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912576 00010000:00010000:3.0:1787599337.257630:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 24 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599337.257645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599337.257653:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577912448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599337.257664:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599337.257669:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257692:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257709:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf075 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf06e expref: 24 pid: 6512 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257725:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599337.257757:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3645:x1874433577912448:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599337.257763:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599337.257825:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599337.257838:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3645:x1874433577912576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599337.257845:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599337.257849:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 22 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257857:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 22 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257866:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf01a expref: 22 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.257874:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599337.257894:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433577912576:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599337.257900:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599337.257977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599337.259280:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558976896 00000100:00100000:3.0:1787599337.259289:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558976896 00010000:00010000:3.0:1787599337.259318:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599337.259340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1787599337.259347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558976896:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599337.259359:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599337.259364:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.259375:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 10 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599337.259405:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599337.259544:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558976896:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 196us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599337.259550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1787599337.259611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577912576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599337.259622:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577912448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599337.262827:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.262845:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3821d1600/0x5d2988b0929cf06e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf075 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.262881:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.262883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.262885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.262947:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c000/0x5d2988b0929cf2b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c9 expref: 9 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.262960:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874433577911680:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599337.262994:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.263870:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599337.263876:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599337.263878:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.264172:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.264186:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599337.264190:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.264202:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599337.264210:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599337.264216:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599337.264255:0:10397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.264391:0:10397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599337.264440:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.264462:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf00c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf013 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.264479:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.264480:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.264482:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599337.264587:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577912704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599337.264659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599337.265053:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912704 00000100:00100000:2.0:1787599337.265061:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912704 00010000:00010000:2.0:1787599337.265097:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599337.265133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599337.265142:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3647:x1874433577912704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599337.265154:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599337.265160:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265172:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265189:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152be00/0x5d2988b0929cf013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf00c expref: 21 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265204:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265212:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265239:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265246:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265252:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265328:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265335:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599337.265339:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265347:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265368:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599337.265379:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599337.265486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3647:x1874433577912704:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.265495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599337.265612:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577912704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599337.265644:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.265652:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.265657:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7400/0x5d2988b0929cf377 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.266531:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.266545:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152b400/0x5d2988b0929cf01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf021 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599337.266563:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599337.266565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599337.266568:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599337.702039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599337.948979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599337.949590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977024 00000100:00100000:0.0:1787599337.949603:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977024 00000100:00100000:0.0:1787599337.949667:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1787599337.949678:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:6177:x1874433558977024:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599337.949694:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599337.949715:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.949781:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.949820:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599337.949830:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325000, rc 0) 00000100:00100000:0.0:1787599337.949946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558977024:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 269us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599337.949953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:1.0:1787599337.969431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599337.969502:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977152 00000100:00100000:2.0:1787599337.969513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977152 00000100:00100000:2.0:1787599337.969572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:2.0:1787599337.969597:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558977152:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599337.969748:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558977152:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.969756:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1787599337.972271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599337.972405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977280 00000100:00100000:2.0:1787599337.972415:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977280 00000100:00100000:2.0:1787599337.972481:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:2.0:1787599337.972492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558977280:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599337.972636:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6177:x1874433558977280:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.972645:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:3.0:1787599337.981217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599337.981327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977408 00000100:00100000:1.0:1787599337.981339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977408 00000100:00100000:1.0:1787599337.981393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:1.0:1787599337.981404:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6711:x1874433558977408:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599337.981573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6711:x1874433558977408:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 171us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599337.981581:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:1.0:1787599337.990540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599337.993565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977536 00000100:00100000:2.0:1787599337.993583:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977536 00000100:00100000:2.0:1787599337.993649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:2.0:1787599337.993660:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6711:x1874433558977536:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599337.994045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:6711:x1874433558977536:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 385us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.994054:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1787599338.020987:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577912832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599338.021060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599338.021221:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912832 00000100:00100000:2.0:1787599338.021229:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912832 00000100:00100000:2.0:1787599338.021291:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599338.021300:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577912832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599338.021333:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599338.021376:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577912832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599338.021403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599338.021588:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577912832:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599338.726370:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787599339.174746:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599339.174764:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 4 10000000:01000000:1.0:1787599339.174769:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599339.174830:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.174842:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.174866:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.174891:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577912960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.174960:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.174997:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.175066:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577912960 00000100:00100000:2.0:1787599339.175074:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577912960 00000100:00100000:2.0:1787599339.175126:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787599339.175135:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577912960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599339.175148:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599339.175161:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf385 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.175183:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.175192:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.175201:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7600, rc 0) 00000100:00100000:2.0:1787599339.175259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577912960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.175266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787599339.176370:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577912960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599339.176391:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.176402:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.176537:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.176579:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.176921:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599339.187964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913088 00000100:00100000:0.0:1787599339.187980:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913088 00000100:00100000:1.0:1787599339.188086:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787599339.188098:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577913088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.188277:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577913088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (11696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.188284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787599339.188397:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.188449:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.188499:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.188536:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.188577:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913216 00000100:00100000:2.0:1787599339.188582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913216 00000100:00100000:2.0:1787599339.188614:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787599339.188622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577913216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.188711:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577913216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.188718:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787599339.188837:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.189222:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10482:1874433577913344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.189271:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.189294:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.189338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913344 00000100:00100000:2.0:1787599339.189348:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913344 00000100:00100000:2.0:1787599339.189381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787599339.189390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10482:x1874433577913344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599339.189479:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10482:x1874433577913344:12345-0@lo:502:llog_process_th.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.189486:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787599339.189570:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10482:1874433577913344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599339.189592:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599339.189602:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599339.189605:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599339.189618:0:10482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f896800 00000020:00000080:1.0:1787599339.189621:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599339.189689:0:10482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10482:1874433577913472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599339.189718:0:10482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.189736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913472 00000100:00100000:1.0:1787599339.189740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913472 00000100:00100000:1.0:1787599339.189760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787599339.189767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10482:x1874433577913472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599339.189854:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:10482:x1874433577913472:12345-0@lo:502:llog_process_th.0 Request processed in 87us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.189861:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787599339.189888:0:10482:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.189901:0:10482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10482:1874433577913472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599339.189918:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599339.189922:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599339.189924:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787599339.189928:0:10482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787599339.189976:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787599339.189994:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599339.190003:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190015:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599339.190024:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599339.190027:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3778e6800 from 4 10000000:01000000:1.0:1787599339.190030:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599339.190052:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190065:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190075:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.190088:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190112:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.190125:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.190136:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913600 00000100:00100000:1.0:1787599339.190139:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913600 00000100:00100000:1.0:1787599339.190157:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787599339.190164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577913600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599339.190172:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599339.190183:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf393 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190202:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190211:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190218:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:1.0:1787599339.190253:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577913600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.190258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787599339.190290:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599339.190302:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.190310:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.190351:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190375:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.190387:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.190398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913728 00000100:00100000:1.0:1787599339.190401:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913728 00000100:00100000:1.0:1787599339.190417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787599339.190422:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577913728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577913728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.190506:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787599339.190535:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190557:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190588:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.190601:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.190612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913856 00000100:00100000:1.0:1787599339.190615:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913856 00000100:00100000:1.0:1787599339.190632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787599339.190638:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577913856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.190699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577913856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.190710:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787599339.190742:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577913856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.205284:0:10483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10483:1874433577913984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599339.206235:0:10483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.206984:0:10483:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.207110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577913984 00000100:00100000:1.0:1787599339.207118:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577913984 00000100:00100000:1.0:1787599339.207175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787599339.207185:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10483:x1874433577913984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599339.207335:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10483:x1874433577913984:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.207344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787599339.208997:0:10483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10483:1874433577913984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599339.209046:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599339.209058:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599339.209061:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787599339.209067:0:10483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3778e6800 00000020:00000080:2.0:1787599339.209070:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787599339.209163:0:10483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10483:1874433577914112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599339.209230:0:10483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.209280:0:10483:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599339.209369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914112 00000100:00100000:0.0:1787599339.209377:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914112 00000100:00100000:0.0:1787599339.209899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787599339.209912:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10483:x1874433577914112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.210035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:10483:x1874433577914112:12345-0@lo:502:llog_process_th.0 Request processed in 127us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599339.210043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787599339.210715:0:10483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10483:1874433577914112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599339.212147:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599339.212159:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599339.212162:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787599339.212166:0:10483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787599339.212512:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787599339.212536:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599339.212549:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.212562:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599339.212572:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599339.212575:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3812cf000 from 4 10000000:01000000:1.0:1787599339.212577:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599339.212615:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.212623:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.212633:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.212666:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.212728:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.212770:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.215824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914240 00000100:00100000:2.0:1787599339.215839:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914240 00000100:00100000:2.0:1787599339.215903:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787599339.215913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577914240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599339.215935:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599339.215953:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf3a1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.215981:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.215992:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.216001:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6e00, rc 0) 00000100:00100000:2.0:1787599339.216086:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.216093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787599339.216148:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599339.216164:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.216174:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599339.216263:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.216297:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.216328:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.216341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914368 00000100:00100000:2.0:1787599339.216345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914368 00000100:00100000:2.0:1787599339.216368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787599339.216375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.216486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.216493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787599339.216519:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.216545:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.216581:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.216594:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.216604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914496 00000100:00100000:2.0:1787599339.216607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914496 00000100:00100000:2.0:1787599339.216623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787599339.216629:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.216699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.216706:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787599339.216743:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.224080:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10488:1874433577914624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.224166:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.224272:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.232283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914624 00000100:00100000:2.0:1787599339.232312:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914624 00000100:00100000:2.0:1787599339.232389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787599339.232400:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10488:x1874433577914624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599339.232617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10488:x1874433577914624:12345-0@lo:502:llog_process_th.0 Request processed in 218us (8451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.232624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787599339.232857:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10488:1874433577914624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599339.232895:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599339.232905:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599339.232908:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787599339.232916:0:10488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3812cf000 00000020:00000080:0.0:1787599339.232918:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599339.233013:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10488:1874433577914752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.233065:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.233097:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599339.234778:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914752 00000100:00100000:3.0:1787599339.234821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914752 00000100:00100000:3.0:1787599339.234872:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787599339.234882:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10488:x1874433577914752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599339.235046:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:10488:x1874433577914752:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599339.235053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787599339.235065:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10488:1874433577914752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599339.235095:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599339.235101:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599339.235103:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787599339.235107:0:10488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787599339.235491:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787599339.235513:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599339.235523:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.235541:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599339.235553:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599339.235556:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3707b1000 from 4 10000000:01000000:2.0:1787599339.235559:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599339.235589:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.235597:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.235607:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599339.235626:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.237925:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.238661:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f26e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599339.245490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577914880 00000100:00100000:0.0:1787599339.245508:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577914880 00000100:00100000:0.0:1787599339.245588:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787599339.245605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577914880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599339.245623:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599339.245643:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf3af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599339.245668:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599339.245678:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599339.245687:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324800, rc 0) 00000100:00100000:0.0:1787599339.245776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577914880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599339.245782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787599339.248138:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577914880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599339.248166:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599339.248179:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599339.248270:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577915008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.248325:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599339.248367:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599339.249623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915008 00000100:00100000:1.0:1787599339.249634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915008 00000100:00100000:1.0:1787599339.249692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787599339.249702:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577915008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599339.249887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577915008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599339.249895:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787599339.249975:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577915008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.250020:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577915136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.250062:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.251305:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.257706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915136 00000100:00100000:2.0:1787599339.257725:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915136 00000100:00100000:2.0:1787599339.257830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787599339.257842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577915136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599339.258011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577915136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (7950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.258021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787599339.258071:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577915136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599339.261598:0:10494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10494:1874433577915264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.261679:0:10494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.261764:0:10494:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599339.269132:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915264 00000100:00100000:2.0:1787599339.269156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915264 00000100:00100000:2.0:1787599339.269219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787599339.269229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:10494:x1874433577915264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599339.269404:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:10494:x1874433577915264:12345-0@lo:502:llog_process_th.0 Request processed in 176us (7725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.269412:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787599339.269680:0:10494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10494:1874433577915264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599339.269715:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599339.269725:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599339.269727:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787599339.269734:0:10494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3707b1000 00000020:00000080:0.0:1787599339.269744:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599339.270454:0:10494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10494:1874433577915392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.270502:0:10494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599339.270533:0:10494:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599339.272023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915392 00000100:00100000:0.0:1787599339.272035:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915392 00000100:00100000:0.0:1787599339.272087:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787599339.272097:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:10494:x1874433577915392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599339.272235:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:10494:x1874433577915392:12345-0@lo:502:llog_process_th.0 Request processed in 138us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599339.272255:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787599339.272310:0:10494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:10494:1874433577915392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599339.272336:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599339.272342:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599339.272344:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787599339.272350:0:10494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787599339.273581:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787599339.273609:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599339.273619:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599339.273631:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599339.561641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599339.561664:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577915520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599339.561746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599339.561969:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915520 00000100:00100000:2.0:1787599339.561978:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915520 00000100:00100000:2.0:1787599339.562024:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599339.562034:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577915520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599339.562066:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599339.562124:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577915520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599339.562132:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599339.562209:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577915520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599339.751414:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599340.488626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599340.488674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599340.488706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599340.488727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599340.488748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599340.488777:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978176 00000100:00100000:0.0:1787599340.488788:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978176 00000100:00100000:0.0:1787599340.488886:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978048 00000100:00100000:0.0:1787599340.488890:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978048 00000100:00100000:0.0:1787599340.488915:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599340.488927:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558978176:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599340.489006:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558978176:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599340.489013:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599340.489030:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1787599340.489037:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558978048:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599340.489060:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558978048:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599340.489065:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1787599340.489083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977920 00000100:00100000:0.0:1787599340.489087:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977920 00000100:00100000:0.0:1787599340.489113:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977792 00000100:00100000:0.0:1787599340.489115:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977792 00000100:00100000:0.0:1787599340.489134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1787599340.489141:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558977920:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599340.489168:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558977920:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599340.489173:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1787599340.489184:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1787599340.489189:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558977792:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599340.489211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558977792:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599340.489229:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1787599340.489353:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558977664 00000100:00100000:2.0:1787599340.489358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558977664 00000100:00100000:2.0:1787599340.489388:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:2.0:1787599340.489407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558977664:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599340.489434:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558977664:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599340.489446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00080000:1.0:1787599340.489698:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599340.489703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599340.489706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599340.489709:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787599340.777523:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599341.606209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599341.606243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577915648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599341.606316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.606765:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915648 00000100:00100000:0.0:1787599341.606773:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915648 00000100:00100000:0.0:1787599341.606962:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599341.606973:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577915648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599341.607001:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599341.607042:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577915648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.607050:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599341.607071:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577915776:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577916288:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607157:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577916800:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607195:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599341.607214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607245:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787599341.607251:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577915904:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607285:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577916416:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577916928:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607367:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577916032:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607401:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577916544:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607426:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577917056:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787599341.607470:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ad880 x1874433577915648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599341.607489:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577915648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599341.607504:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787599341.607509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607537:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577916672:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599341.607565:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577917184:0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787599341.607601:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599341.607612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915776 00000100:00100000:0.0:1787599341.607615:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915776 00000100:00100000:0.0:1787599341.607643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787599341.607650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577915776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577915776:12345-0@lo:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.607700:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787599341.607731:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916288 00000100:00100000:0.0:1787599341.607734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916288 00000100:00100000:0.0:1787599341.607755:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916032 00000100:00100000:0.0:1787599341.607757:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916032 00000100:00100000:0.0:1787599341.607769:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599341.607774:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577916288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607827:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577916288:12345-0@lo:400:kworker.0 Request processed in 53us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.607834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599341.607845:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599341.607851:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577916032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.607883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577916032:12345-0@lo:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.607888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599341.607903:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916800 00000100:00100000:0.0:1787599341.607906:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916800 00000100:00100000:0.0:1787599341.607926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577915904 00000100:00100000:0.0:1787599341.607928:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577915904 00000100:00100000:0.0:1787599341.607938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916416 00000100:00100000:0.0:1787599341.607940:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916416 00000100:00100000:0.0:1787599341.607951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916928 00000100:00100000:0.0:1787599341.607952:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916928 00000100:00100000:0.0:1787599341.607963:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916544 00000100:00100000:0.0:1787599341.607965:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916544 00000100:00100000:0.0:1787599341.607974:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916160 00000100:00100000:0.0:1787599341.607976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916160 00000100:00100000:0.0:1787599341.607987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787599341.607992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.608025:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577916800:12345-0@lo:400:kworker.0 Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608032:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787599341.608042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599341.608048:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577915904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.608069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577915904:12345-0@lo:400:kworker.0 Request processed in 21us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599341.608084:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599341.608089:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577916416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.608112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577916416:12345-0@lo:400:kworker.0 Request processed in 23us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599341.608128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599341.608133:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577916928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.608154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577916928:12345-0@lo:400:kworker.0 Request processed in 22us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608159:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599341.608168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599341.608174:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577916544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599341.608193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577916544:12345-0@lo:400:kworker.0 Request processed in 20us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608198:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599341.608207:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599341.608212:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577916160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599341.608445:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917312 00000100:00100000:3.0:1787599341.608450:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917312 00000100:00100000:3.0:1787599341.608477:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599341.608483:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599341.608495:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599341.608526:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599341.608531:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599341.608973:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577916160:12345-0@lo:400:kworker.0 Request processed in 760us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599341.608980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599341.609016:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917056 00000100:00100000:0.0:1787599341.609019:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917056 00000100:00100000:0.0:1787599341.609083:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577916672 00000100:00100000:0.0:1787599341.609087:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577916672 00000100:00100000:1.0:1787599341.609859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577915904:0@lo:400:kworker.0 00000100:00100000:1.0:1787599341.609887:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577916416:0@lo:400:kworker.0 00010000:00080000:1.0:1787599341.609900:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243409180 x1874433577916928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599341.609910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577916928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599341.609920:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577915776:0@lo:400:kworker.0 00000100:00100000:1.0:1787599341.609936:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577916288:0@lo:400:kworker.0 00000100:00100000:1.0:1787599341.609947:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577916800:0@lo:400:kworker.0 00010000:00080000:1.0:1787599341.609957:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b2300 x1874433577917312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599341.609972:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599341.610433:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917184 00000100:00100000:3.0:1787599341.610445:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917184 00000100:00100000:3.0:1787599341.610479:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599341.610487:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577917056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599341.610546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577917056:12345-0@lo:400:kworker.0 Request processed in 59us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599341.610551:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599341.610565:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599341.610571:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577916672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599341.610597:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577916672:12345-0@lo:400:kworker.0 Request processed in 27us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599341.610602:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599341.610614:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599341.610620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577917184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599341.610647:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577917184:12345-0@lo:400:kworker.0 Request processed in 27us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599341.610652:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787599341.615891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599341.615901:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599341.615905:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599341.615908:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599341.615963:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577916160:0@lo:400:kworker.0 00010000:00080000:2.0:1787599341.615982:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243409c00 x1874433577916672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599341.615993:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577916672:0@lo:400:kworker.0 00010000:00080000:2.0:1787599341.616006:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243681f80 x1874433577917184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599341.616015:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577917184:0@lo:400:kworker.0 00000100:00100000:2.0:1787599341.616028:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577916032:0@lo:400:kworker.0 00010000:00080000:2.0:1787599341.616041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340ad80 x1874433577916544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599341.616049:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577916544:0@lo:400:kworker.0 00010000:00080000:2.0:1787599341.616064:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243408700 x1874433577917056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599341.616072:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577917056:0@lo:400:kworker.0 00010000:00010000:2.0:1787599341.798033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599342.118924:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599342.118950:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577917440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599342.119032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599342.122435:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917440 00000100:00100000:0.0:1787599342.122448:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917440 00000100:00100000:0.0:1787599342.122500:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599342.122511:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577917440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599342.122541:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599342.122632:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577917440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599342.122639:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599342.122673:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599342.122689:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577917568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599342.122728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787599342.122917:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b47480 x1874433577917440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599342.122939:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577917440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599342.126163:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917568 00000100:00100000:2.0:1787599342.126179:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917568 00000100:00100000:2.0:1787599342.126269:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599342.126282:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577917568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599342.126311:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599342.126424:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577917568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599342.126432:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787599342.126494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435aea00 x1874433577917568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599342.126518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577917568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787599342.823552:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599343.142048:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599343.142075:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577917696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599343.142153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599343.142231:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917696 00000100:00100000:2.0:1787599343.142241:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917696 00000100:00100000:2.0:1787599343.142292:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599343.142302:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577917696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599343.142338:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599343.142384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577917696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.142392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599343.142442:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577917696:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787599343.386236:0:10697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787599343.845173:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599344.677750:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599344.677841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599344.678167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917824 00000100:00100000:2.0:1787599344.678177:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917824 00000100:00100000:2.0:1787599344.678261:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599344.678271:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599344.678309:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599344.678372:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599344.678379:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787599344.678453:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599344.869678:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599345.608309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599345.608372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599345.608402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599345.608446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599345.608471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599345.608505:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978816 00000100:00100000:0.0:1787599345.608517:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978816 00000100:00100000:0.0:1787599345.608586:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978688 00000100:00100000:0.0:1787599345.608590:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978688 00000100:00100000:0.0:1787599345.608613:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599345.608623:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978816:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599345.608700:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978816:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599345.608709:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599345.608727:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599345.608734:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599345.608758:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599345.608764:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599345.608785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978560 00000100:00100000:0.0:1787599345.608788:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978560 00000100:00100000:0.0:1787599345.608845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978432 00000100:00100000:0.0:1787599345.608849:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978432 00000100:00100000:0.0:1787599345.608869:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1787599345.608875:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599345.608901:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558978560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599345.608907:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1787599345.608918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1787599345.608933:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558978432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599345.608961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558978432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599345.608966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00080000:0.0:1787599345.608985:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599345.608989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599345.608991:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599345.608993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599345.609169:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978304 00000100:00100000:1.0:1787599345.609173:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978304 00000100:00100000:1.0:1787599345.609216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 278 00000100:00100000:1.0:1787599345.609227:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558978304:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599345.609257:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558978304:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599345.609262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 278 00010000:00010000:2.0:1787599345.894659:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599346.726916:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599346.726939:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599346.727024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.727343:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577917952 00000100:00100000:2.0:1787599346.727352:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577917952 00000100:00100000:2.0:1787599346.727438:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599346.727448:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599346.727478:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599346.727533:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577917952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.727541:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787599346.727598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599346.730451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577918080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599346.730516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577918592:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731312:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577919104:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731351:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577919616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731396:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599346.731402:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731462:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577918720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731487:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577919232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731555:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577918464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731588:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577918976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731615:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577919488:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731645:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787599346.731650:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577918336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731678:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577918848:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731700:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599346.731759:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918592 00000100:00100000:2.0:1787599346.731767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918592 00000100:00100000:2.0:1787599346.731821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919232 00000100:00100000:2.0:1787599346.731824:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919232 00000100:00100000:2.0:1787599346.731845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918976 00000100:00100000:2.0:1787599346.731848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918976 00000100:00100000:2.0:1787599346.731858:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918336 00000100:00100000:2.0:1787599346.731860:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918336 00000100:00100000:2.0:1787599346.731879:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918848 00000100:00100000:2.0:1787599346.731882:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918848 00000100:00100000:2.0:1787599346.731892:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919360 00000100:00100000:2.0:1787599346.731894:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919360 00000100:00100000:2.0:1787599346.731906:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599346.731914:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577918592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.731966:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577918592:12345-0@lo:400:kworker.0 Request processed in 52us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.731973:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599346.731988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599346.731994:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577919232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732021:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577919232:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732027:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599346.732038:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599346.732044:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577918976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577918976:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599346.732088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599346.732093:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577918336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732116:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577918336:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599346.732131:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599346.732137:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577918848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577918848:12345-0@lo:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599346.732200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599346.732206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732231:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577919360:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732236:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599346.732254:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919104 00000100:00100000:2.0:1787599346.732257:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919104 00000100:00100000:2.0:1787599346.732283:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919616 00000100:00100000:2.0:1787599346.732285:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919616 00000100:00100000:2.0:1787599346.732296:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919488 00000100:00100000:2.0:1787599346.732299:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919488 00000100:00100000:2.0:1787599346.732309:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599346.732314:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732340:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577919104:12345-0@lo:400:kworker.0 Request processed in 26us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732346:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599346.732355:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599346.732360:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577919616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732380:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577919616:12345-0@lo:400:kworker.0 Request processed in 21us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732385:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599346.732393:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599346.732398:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577919488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732427:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577919488:12345-0@lo:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732432:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599346.732450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918208 00000100:00100000:2.0:1787599346.732452:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918208 00000100:00100000:2.0:1787599346.732474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787599346.732480:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732503:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577918208:12345-0@lo:400:kworker.0 Request processed in 24us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732509:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787599346.732534:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918720 00000100:00100000:2.0:1787599346.732537:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918720 00000100:00100000:2.0:1787599346.732556:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918464 00000100:00100000:2.0:1787599346.732558:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918464 00000100:00100000:2.0:1787599346.732569:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599346.732574:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577918720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732600:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577918720:12345-0@lo:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732606:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599346.732615:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599346.732620:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577918464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732641:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577918464:12345-0@lo:400:kworker.0 Request processed in 21us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.732646:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599346.732690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732703:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577918720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577919232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732732:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577918592:0@lo:400:kworker.0 00010000:00080000:2.0:1787599346.732744:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340bb80 x1874433577919104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732755:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577919104:0@lo:400:kworker.0 00010000:00080000:2.0:1787599346.732765:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1880 x1874433577919616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732774:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577919616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732837:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577918336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732846:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577918848:0@lo:400:kworker.0 00010000:00080000:2.0:1787599346.732855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340aa00 x1874433577919360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732862:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787599346.732871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577918464:0@lo:400:kworker.0 00010000:00080000:2.0:1787599346.732880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243408000 x1874433577918976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732887:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577918976:0@lo:400:kworker.0 00010000:00080000:2.0:1787599346.732895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24340b480 x1874433577919488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732903:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577919488:0@lo:400:kworker.0 00000100:00080000:2.0:1787599346.732942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599346.732947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599346.732949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599346.732951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599346.732972:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b47800 x1874433577917952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599346.732988:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577917952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599346.736051:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577918080 00000100:00100000:1.0:1787599346.736063:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577918080 00000100:00100000:1.0:1787599346.736141:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599346.736151:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577918080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599346.736187:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599346.736271:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577918080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599346.736278:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787599346.741441:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435aed80 x1874433577918080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599346.741468:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577918080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787599346.916973:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599347.236944:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599347.236966:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577919744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599347.237045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599347.237119:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919744 00000100:00100000:2.0:1787599347.237128:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919744 00000100:00100000:2.0:1787599347.237188:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599347.237198:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577919744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599347.237228:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599347.237284:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577919744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599347.237292:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787599347.237328:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9180 x1874433577919744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599347.237346:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577919744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599347.238093:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599347.239612:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577919872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599347.239673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599347.239835:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577919872 00000100:00100000:2.0:1787599347.239843:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577919872 00000100:00100000:2.0:1787599347.239897:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599347.239906:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577919872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599347.239946:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599347.239991:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577919872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599347.239998:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787599347.240558:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9180 x1874433577919872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599347.240577:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577919872:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787599347.941369:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599348.269106:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599348.269130:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577920000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599348.269218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599348.269359:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920000 00000100:00100000:2.0:1787599348.269368:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920000 00000100:00100000:2.0:1787599348.269427:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599348.269437:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577920000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599348.269487:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599348.269538:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577920000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599348.269545:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599348.269598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577920000:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787599348.478753:0:10941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing yml_node 00010000:00010000:2.0:1787599348.965280:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599349.800984:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599349.803990:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577920128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599349.804082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599349.805461:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920128 00000100:00100000:2.0:1787599349.805473:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920128 00000100:00100000:2.0:1787599349.805533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599349.805542:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577920128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599349.805578:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599349.805653:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577920128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599349.805661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599349.806451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577920128:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599349.989155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599350.731925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599350.731985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599350.732022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599350.732204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979200 00000100:00100000:2.0:1787599350.732217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979200 00000100:00100000:2.0:1787599350.732319:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979072 00000100:00100000:2.0:1787599350.732323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979072 00000100:00100000:2.0:1787599350.732356:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1787599350.732370:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558979200:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599350.732489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558979200:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 122us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599350.732497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1787599350.732515:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1787599350.732523:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558979072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599350.732552:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558979072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599350.732558:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00080000:3.0:1787599350.734439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599350.734451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599350.734586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558978944 00000100:00100000:1.0:1787599350.734599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558978944 00000100:00100000:1.0:1787599350.736056:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:1.0:1787599350.736089:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558978944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599350.736344:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558978944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 273us (4429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599350.736355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:3.0:1787599350.751226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599350.751877:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979328 00000100:00100000:2.0:1787599350.751892:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979328 00000100:00100000:2.0:1787599350.751993:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1787599350.752005:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2402:x1874433558979328:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:2.0:1787599350.752052:0:8629:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf2c8 00000100:00080000:2.0:1787599350.752065:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b2434d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599350.752152:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787599350.752837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599350.752868:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979456 00000100:00100000:3.0:1787599350.752874:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979456 00000100:00100000:3.0:1787599350.752909:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599350.752918:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2402:x1874433558979456:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1787599350.752940:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf2cf 00000100:00080000:3.0:1787599350.752948:0:8433:0:(import.c:65:import_set_state_nolock()) ffff96b2434d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599350.752978:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787599350.753132:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+2:2402:x1874433558979456:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 214us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599350.753149:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:3.0:1787599350.753174:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599350.753327:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599350.754730:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+2:2402:x1874433558979328:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 2720us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599350.754742:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00080000:0.0:1787599350.755027:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599350.755033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599351.013094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599351.851122:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577920256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599351.851205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851254:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577920768:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851314:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577921280:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577921792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851405:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787599351.851411:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577920640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577921152:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577921664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851543:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577920384:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851594:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577920896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577921408:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851665:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577921920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851717:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787599351.851724:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577920512:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851764:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577921024:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851822:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577921536:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.851844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.851873:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920256 00000100:00100000:0.0:1787599351.851882:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920256 00000100:00100000:0.0:1787599351.851945:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599351.851955:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577920256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599351.851985:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599351.852030:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577920256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852038:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599351.852061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920768 00000100:00100000:0.0:1787599351.852065:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920768 00000100:00100000:0.0:1787599351.852085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921152 00000100:00100000:0.0:1787599351.852096:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921152 00000100:00100000:0.0:1787599351.852112:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921664 00000100:00100000:0.0:1787599351.852114:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921664 00000100:00100000:0.0:1787599351.852129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920512 00000100:00100000:0.0:1787599351.852141:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920512 00000100:00100000:0.0:1787599351.852153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921024 00000100:00100000:0.0:1787599351.852155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921024 00000100:00100000:0.0:1787599351.852165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921536 00000100:00100000:0.0:1787599351.852168:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921536 00000100:00100000:0.0:1787599351.852182:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787599351.852188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577920768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577920768:12345-0@lo:400:kworker.0 Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852228:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787599351.852239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599351.852245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577921152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577921152:12345-0@lo:400:kworker.0 Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599351.852287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599351.852293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577921664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577921664:12345-0@lo:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599351.852338:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599351.852344:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577920512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577920512:12345-0@lo:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599351.852398:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599351.852404:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577921024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852431:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577921024:12345-0@lo:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599351.852445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599351.852451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577921536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852474:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577921536:12345-0@lo:400:kworker.0 Request processed in 24us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599351.852499:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921280 00000100:00100000:0.0:1787599351.852502:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921280 00000100:00100000:0.0:1787599351.852517:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921792 00000100:00100000:0.0:1787599351.852519:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921792 00000100:00100000:0.0:1787599351.852529:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921408 00000100:00100000:0.0:1787599351.852532:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921408 00000100:00100000:0.0:1787599351.852540:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577921920 00000100:00100000:0.0:1787599351.852542:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577921920 00000100:00100000:0.0:1787599351.852551:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599351.852557:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577921280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852583:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577921280:12345-0@lo:400:kworker.0 Request processed in 26us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852589:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599351.852600:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599351.852606:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577921792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852640:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577921792:12345-0@lo:400:kworker.0 Request processed in 35us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852646:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599351.852657:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599351.852662:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577921408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852688:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577921408:12345-0@lo:400:kworker.0 Request processed in 26us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852694:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599351.852704:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599351.852709:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577921920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852736:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577921920:12345-0@lo:400:kworker.0 Request processed in 27us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852742:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599351.852765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920640 00000100:00100000:0.0:1787599351.852768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920640 00000100:00100000:0.0:1787599351.852813:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920896 00000100:00100000:0.0:1787599351.852816:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920896 00000100:00100000:0.0:1787599351.852831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787599351.852837:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577920640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852871:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577920640:12345-0@lo:400:kworker.0 Request processed in 34us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852876:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787599351.852887:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599351.852894:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577920896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.852921:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577920896:12345-0@lo:400:kworker.0 Request processed in 27us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.852937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599351.852970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577920384 00000100:00100000:0.0:1787599351.852975:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577920384 00000100:00100000:0.0:1787599351.853005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787599351.853011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577920384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853041:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577920384:12345-0@lo:400:kworker.0 Request processed in 30us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.853047:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1787599351.853090:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599351.853096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599351.853098:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599351.853100:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599351.853154:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577920512:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577921024:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853177:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577921536:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853186:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577920384:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853194:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577920896:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853207:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fb480 x1874433577921408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853218:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577921408:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8380 x1874433577921920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853235:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577921920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.853286:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577920640:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853297:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f9180 x1874433577921152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577921152:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8a80 x1874433577921664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577921664:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853332:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243681180 x1874433577920256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853347:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577920256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599351.853359:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577920768:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fad80 x1874433577921280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853375:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577921280:0@lo:400:kworker.0 00010000:00080000:0.0:1787599351.853385:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fbb80 x1874433577921792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599351.853392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577921792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599351.856040:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577922048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599351.856106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.856463:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922048 00000100:00100000:3.0:1787599351.856471:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922048 00000100:00100000:3.0:1787599351.856523:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599351.856534:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577922048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599351.856554:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599351.856603:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577922048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.856610:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787599351.856659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b1c00 x1874433577922048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599351.856677:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577922048:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787599352.015114:0:11124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:3.0:1787599352.038178:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599352.368093:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599352.368116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577922176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599352.368201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599352.368336:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922176 00000100:00100000:1.0:1787599352.368344:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922176 00000100:00100000:1.0:1787599352.368388:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787599352.368397:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577922176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599352.368424:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599352.368469:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577922176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599352.368476:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787599352.368512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2300 x1874433577922176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599352.368531:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577922176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599352.375641:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577922304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599352.375988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599352.380724:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922304 00000100:00100000:3.0:1787599352.380741:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922304 00000100:00100000:2.0:1787599352.391102:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599352.391120:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577922304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599352.391163:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599352.391252:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577922304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (15264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.391260:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787599352.391305:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ca80 x1874433577922304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599352.391328:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577922304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787599353.061079:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599353.381062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577922432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599353.381170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599353.381558:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922432 00000100:00100000:2.0:1787599353.381567:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922432 00000100:00100000:2.0:1787599353.381857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787599353.381871:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577922432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599353.381909:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599353.382015:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577922432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599353.382444:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577922432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599353.383750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1787599354.086083:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599354.164202:0:11222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00000100:00100000:3.0:1787599354.919993:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599354.920018:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577922560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599354.920090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599354.920163:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922560 00000100:00100000:3.0:1787599354.920171:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922560 00000100:00100000:3.0:1787599354.920215:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599354.920224:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577922560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599354.920258:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787599354.920304:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577922560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599354.920312:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599354.920356:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577922560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599355.117529:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599355.847938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599355.847983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599355.848023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599355.848133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979584 00000100:00100000:2.0:1787599355.848145:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979584 00000100:00100000:2.0:1787599355.848219:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:2.0:1787599355.848231:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558979584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599355.848319:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558979584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 90us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599355.848327:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:1.0:1787599355.848666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979840 00000100:00100000:1.0:1787599355.848672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979840 00000100:00100000:1.0:1787599355.848722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979712 00000100:00100000:1.0:1787599355.848725:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979712 00000100:00100000:1.0:1787599355.848747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1787599355.848754:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558979840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599355.848824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558979840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599355.848830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1787599355.848846:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1787599355.848870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558979712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599355.848895:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558979712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599355.848900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00080000:2.0:1787599355.851152:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599355.851176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787599356.132949:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599356.459034:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:3.0:1787599356.459045:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b2434d4800/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:0.0:1787599356.459119:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d4800/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-OST0000 00000020:00000080:0.0:1787599356.459188:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2434d2800 for lustre-OST0000 00000001:00100000:1.0:1787599356.465226:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:1.0:1787599356.465235:0:9515:0:(genops.c:885:class_export_put()) final put ffff96b2434d4000/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:3.0:1787599356.465412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d4000/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-OST0001 00000020:00000080:3.0:1787599356.465462:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2434d3800 for lustre-OST0001 00000001:02000400:2.0:1787599356.774872:0:11319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00000100:00100000:0.0:1787599356.965439:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599356.965480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577922688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599356.965563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599356.965642:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922688 00000100:00100000:0.0:1787599356.965650:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922688 00000100:00100000:0.0:1787599356.965702:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599356.965713:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577922688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599356.965747:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599356.965822:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577922688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599356.965830:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787599356.965854:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599356.965903:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2fb80 x1874433577922688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599356.965927:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577922688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599356.966507:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577923200:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.966547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.966568:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577923712:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.966593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.966613:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599356.966619:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577922816:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.966645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.966668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577923328:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.966690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.966705:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577923840:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.966724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.966751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923200 00000100:00100000:1.0:1787599356.966756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923200 00000100:00100000:1.0:1787599356.966787:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923840 00000100:00100000:1.0:1787599356.966924:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923840 00000100:00100000:1.0:1787599356.967042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787599356.967053:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577923200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.967113:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577923200:12345-0@lo:400:kworker.0 Request processed in 62us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.967141:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787599356.967158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787599356.967165:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577923840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.967192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577923840:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.967199:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787599356.967223:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923712 00000100:00100000:1.0:1787599356.967228:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923712 00000100:00100000:1.0:1787599356.967261:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599356.967269:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577923712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.967300:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577923712:12345-0@lo:400:kworker.0 Request processed in 33us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.967306:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599356.967326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922816 00000100:00100000:1.0:1787599356.967330:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922816 00000100:00100000:1.0:1787599356.967362:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787599356.967369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577922816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.967404:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577922816:12345-0@lo:400:kworker.0 Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.967410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1787599356.967536:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599356.967542:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599356.967656:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577922944:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.967692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599356.968135:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577924352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599356.968166:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599356.968199:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599356.968205:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577924224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599356.968229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599356.968257:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924224 00000100:00100000:0.0:1787599356.968262:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924224 00000100:00100000:0.0:1787599356.968295:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599356.968302:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577924224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599356.968347:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577924224:12345-0@lo:400:kworker.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599356.968354:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787599356.968371:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787599356.968394:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8700 x1874433577924224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599356.968406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577924224:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.968668:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924352 00000100:00100000:3.0:1787599356.968673:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924352 00000100:00100000:3.0:1787599356.968707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599356.968714:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577924352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599356.968730:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599356.968766:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577924352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599356.968771:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787599356.968916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b3480 x1874433577924352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599356.968930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577924352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599356.969058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923328 00000100:00100000:3.0:1787599356.969063:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923328 00000100:00100000:3.0:1787599356.969104:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787599356.969112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577923328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.969147:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577923328:12345-0@lo:400:kworker.0 Request processed in 36us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599356.969153:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787599356.969173:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577923072:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.969200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599356.969268:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577923456:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.969294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599356.969387:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599356.969526:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923072 00000100:00100000:0.0:1787599356.969531:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923072 00000100:00100000:0.0:1787599356.969565:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599356.969573:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577923072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599356.969616:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577923072:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599356.969621:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787599356.969747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577923968:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.969769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599356.970063:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577922944 00000100:00100000:1.0:1787599356.970068:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577922944 00000100:00100000:1.0:1787599356.970101:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923456 00000100:00100000:1.0:1787599356.970105:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923456 00000100:00100000:1.0:1787599356.970129:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599356.970135:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577922944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.970188:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577922944:12345-0@lo:400:kworker.0 Request processed in 53us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.970195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599356.970209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787599356.970216:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577923456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.970242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577923456:12345-0@lo:400:kworker.0 Request processed in 27us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.970248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787599356.970263:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599356.970345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577922944:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.970355:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577923456:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.970382:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599356.970396:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577924096:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.970418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599356.970533:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577923072:0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.970555:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924096 00000100:00100000:2.0:1787599356.970559:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924096 00000100:00100000:2.0:1787599356.970590:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599356.970596:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577924096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599356.970630:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577924096:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599356.970636:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787599356.970648:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787599356.970663:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8000 x1874433577924096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599356.970673:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577924096:0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.970742:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923968 00000100:00100000:1.0:1787599356.970746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923968 00000100:00100000:1.0:1787599356.970778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577923584 00000100:00100000:1.0:1787599356.970781:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577923584 00000100:00100000:1.0:1787599356.970831:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787599356.970838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577923968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.970873:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577923968:12345-0@lo:400:kworker.0 Request processed in 36us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.970879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787599356.970890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787599356.970897:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577923584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599356.970924:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577923584:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.970929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787599356.971084:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787599356.971111:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434ea300 x1874433577923584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599356.971121:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577923584:0@lo:400:kworker.0 00010000:00080000:2.0:1787599356.971143:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9500 x1874433577923968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599356.971153:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577923968:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.972064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577922816:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.972080:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577923328:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.972103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577923840:0@lo:400:kworker.0 00000100:00100000:3.0:1787599356.972115:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577923200:0@lo:400:kworker.0 00010000:00080000:3.0:1787599356.972145:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434eaa00 x1874433577923712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599356.972156:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577923712:0@lo:400:kworker.0 00010000:00010000:3.0:1787599357.157020:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599357.477325:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577924480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599357.477408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599357.478566:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924480 00000100:00100000:1.0:1787599357.478581:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924480 00000100:00100000:1.0:1787599357.478643:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787599357.478654:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577924480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599357.478711:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599357.478787:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577924480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599357.478812:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787599357.479597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433577924480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599357.479620:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577924480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599357.481708:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577924608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599357.481824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599357.482786:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924608 00000100:00100000:1.0:1787599357.482818:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924608 00000100:00100000:1.0:1787599357.482876:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599357.482887:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577924608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599357.482915:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599357.487451:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577924608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4545us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599357.487466:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787599357.493373:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ce00 x1874433577924608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599357.493411:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577924608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787599358.181346:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599358.403486:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 15:22:36 EDT 2026 00000100:00100000:0.0:1787599358.508613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577924736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599358.508687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599358.510696:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924736 00000100:00100000:3.0:1787599358.510711:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924736 00000100:00100000:3.0:1787599358.510857:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787599358.510869:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577924736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599358.510909:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599358.511820:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577924736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 923us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599358.511830:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599358.511952:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577924736:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599359.205339:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599360.037580:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599360.037606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577924864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599360.037691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599360.038651:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924864 00000100:00100000:3.0:1787599360.038664:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924864 00000100:00100000:3.0:1787599360.038740:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787599360.038754:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577924864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599360.038823:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787599360.038896:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577924864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599360.038904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787599360.039128:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577924864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599360.230703:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599360.987860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599360.987901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599360.987932:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558979968 00000100:00100000:0.0:1787599360.987948:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558979968 00000100:00100000:0.0:1787599360.988001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:0.0:1787599360.988011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558979968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599360.988091:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433558979968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599360.988098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:1.0:1787599360.989701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980096 00000100:00100000:1.0:1787599360.989714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980096 00000100:00100000:1.0:1787599360.989780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1787599360.989807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558980096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599360.989880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558980096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599360.989888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00080000:2.0:1787599360.990701:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599361.000523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599361.000978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980224 00000100:00100000:2.0:1787599361.000991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980224 00000100:00100000:2.0:1787599361.001086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1787599361.001097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558980224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599361.001185:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558980224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599361.001207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00080000:0.0:1787599361.001416:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787599361.256656:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599362.085053:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577924992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599362.085129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.085315:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577925120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599362.085350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.085375:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599362.085380:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577925504:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.085408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.085437:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925120 00000100:00100000:3.0:1787599362.085455:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925120 00000100:00100000:3.0:1787599362.085505:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599362.085513:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577925120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599362.085539:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599362.085583:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577925120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599362.085590:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787599362.085618:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599362.085641:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ea00 x1874433577925120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599362.085659:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577925120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599362.085691:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577925248:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.085712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.085729:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599362.085734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577925376:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.085753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.085774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577924992 00000100:00100000:3.0:1787599362.085777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577924992 00000100:00100000:3.0:1787599362.085833:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787599362.085839:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577924992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599362.091175:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925504 00000100:00100000:0.0:1787599362.091191:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925504 00000100:00100000:3.0:1787599362.091441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577924992:12345-0@lo:400:kworker.0 Request processed in 5597us (6307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599362.091463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787599362.091496:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925248 00000100:00100000:3.0:1787599362.091500:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925248 00000100:00100000:3.0:1787599362.091536:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787599362.091544:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577925248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.091627:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577925248:12345-0@lo:400:kworker.0 Request processed in 84us (5914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599362.091634:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787599362.091650:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925376 00000100:00100000:3.0:1787599362.091653:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925376 00000100:00100000:3.0:1787599362.091673:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787599362.091679:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577925376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.091709:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577925376:12345-0@lo:400:kworker.0 Request processed in 30us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599362.091715:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787599362.091774:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577925632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599362.091822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599362.091872:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577925376:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.091883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577925248:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.091940:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925632 00000100:00100000:3.0:1787599362.091943:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925632 00000100:00100000:3.0:1787599362.091974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599362.091979:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577925632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599362.092009:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599362.092133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787599362.092140:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577925504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599362.092178:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577925504:12345-0@lo:400:kworker.0 Request processed in 39us (6769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599362.092184:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787599362.092207:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577925504:0@lo:400:kworker.0 00000100:00100000:3.0:1787599362.094339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577925632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2351us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599362.094351:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787599362.094392:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599362.094571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2e680 x1874433577925632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599362.094595:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577925632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599362.096515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577924992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599362.097243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577925760:0@lo:400:kworker.0 00000100:00100000:1.0:1787599362.097306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.097383:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925760 00000100:00100000:2.0:1787599362.097389:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925760 00000100:00100000:2.0:1787599362.097429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599362.097438:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.100326:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577925760:12345-0@lo:400:kworker.0 Request processed in 2877us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.100345:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599362.100473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577925888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.100527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.100572:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577925888 00000100:00100000:2.0:1787599362.100581:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577925888 00000100:00100000:2.0:1787599362.100627:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787599362.100637:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577925888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.100684:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577925888:12345-0@lo:400:kworker.0 Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.100690:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787599362.100810:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577925888:0@lo:400:kworker.0 00000100:00080000:2.0:1787599362.100838:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599362.100894:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599362.100981:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577926272:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.101034:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577926016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.101089:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599362.101106:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577926144:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.101162:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926272 00000100:00100000:2.0:1787599362.101166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926272 00000100:00100000:2.0:1787599362.101189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926016 00000100:00100000:2.0:1787599362.101192:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926016 00000100:00100000:2.0:1787599362.101203:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926144 00000100:00100000:2.0:1787599362.101205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926144 00000100:00100000:2.0:1787599362.101216:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787599362.101221:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577926272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577926272:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.101262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787599362.101273:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787599362.101279:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577926016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101305:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577926016:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.101310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787599362.101320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787599362.101327:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101351:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577926144:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.101356:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1787599362.101378:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8000 x1874433577926272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599362.101388:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577926272:0@lo:400:kworker.0 00000100:00080000:2.0:1787599362.101414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599362.101417:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599362.101431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577926144:0@lo:400:kworker.0 00010000:00080000:2.0:1787599362.101439:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9f80 x1874433577926016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599362.101453:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577926016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101482:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577926400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.101560:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577926528:0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.101625:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926400 00000100:00100000:2.0:1787599362.101629:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926400 00000100:00100000:2.0:1787599362.101653:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926528 00000100:00100000:2.0:1787599362.101655:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926528 00000100:00100000:2.0:1787599362.101670:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599362.101675:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577926400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577926400:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.101914:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599362.101930:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599362.101936:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577926528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599362.101967:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577926528:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.101972:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787599362.102000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9f80 x1874433577926400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599362.102015:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577926400:0@lo:400:kworker.0 00000100:00080000:2.0:1787599362.102029:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787599362.102055:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8000 x1874433577926528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599362.102064:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577926528:0@lo:400:kworker.0 00000100:00100000:1.0:1787599362.102383:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577925760:0@lo:400:kworker.0 00010000:00010000:3.0:1787599362.276989:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599362.597053:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577926656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599362.597122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599362.597265:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926656 00000100:00100000:1.0:1787599362.597272:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926656 00000100:00100000:1.0:1787599362.597315:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787599362.597321:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577926656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599362.597346:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599362.597384:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577926656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599362.597389:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787599362.597419:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433577926656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599362.597433:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577926656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599362.597721:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577926784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599362.597750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599362.597949:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926784 00000100:00100000:2.0:1787599362.597954:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926784 00000100:00100000:2.0:1787599362.597980:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599362.597986:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577926784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599362.597995:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599362.598022:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577926784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599362.598028:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787599362.598094:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434ea680 x1874433577926784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599362.598104:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577926784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599363.303949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599363.621286:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599363.621309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577926912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599363.621379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599363.621505:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577926912 00000100:00100000:3.0:1787599363.621514:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577926912 00000100:00100000:3.0:1787599363.621584:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787599363.621595:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577926912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599363.621638:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599363.621693:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577926912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599363.621701:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599363.621935:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577926912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787599364.324990:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599365.158007:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599365.158044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577927040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599365.158133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599365.158215:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927040 00000100:00100000:2.0:1787599365.158225:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927040 00000100:00100000:2.0:1787599365.158294:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599365.158305:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577927040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599365.158342:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599365.158389:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577927040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599365.158429:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599365.158488:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577927040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787599365.352596:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599366.088399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599366.088486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599366.088605:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980480 00000100:00100000:0.0:1787599366.088605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980352 00000100:00100000:2.0:1787599366.088618:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980480 00000100:00100000:0.0:1787599366.088618:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980352 00000100:00100000:2.0:1787599366.088696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1787599366.088700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:2.0:1787599366.088712:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558980480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599366.088713:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558980352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:3.0:1787599366.088822:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599366.088833:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2406:x1874433558980352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599366.088986:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:2.0:1787599366.091377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558980480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2541us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599366.091393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1787599366.092159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599366.092238:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980608 00000100:00100000:2.0:1787599366.092402:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980608 00000100:00100000:2.0:1787599366.092540:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1787599366.092563:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558980608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599366.092640:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558980608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599366.092647:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00080000:3.0:1787599366.093128:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787599366.374732:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599367.206439:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577927552:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.206609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.206705:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577927168:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.206748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.206834:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577927680:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.206863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.206886:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577928192:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.206910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.206927:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577928704:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.206963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.207015:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577927424:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.207043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.207062:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577927936:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.207096:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927168 00000100:00100000:2.0:1787599367.207106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927168 00000100:00100000:2.0:1787599367.207174:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787599367.207184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577927168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.207243:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577927168:12345-0@lo:400:kworker.0 Request processed in 60us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.207251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787599367.207288:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927680 00000100:00100000:2.0:1787599367.207292:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927680 00000100:00100000:2.0:1787599367.207315:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927424 00000100:00100000:2.0:1787599367.207318:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927424 00000100:00100000:2.0:1787599367.207332:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599367.207339:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577927680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.207376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577927680:12345-0@lo:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.207383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599367.207396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599367.207402:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577927424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.207436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577927424:12345-0@lo:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.207441:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599367.207461:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928192 00000100:00100000:2.0:1787599367.207473:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928192 00000100:00100000:0.0:1787599367.208383:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577928064:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.208423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599367.208450:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577928576:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.208474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599367.208526:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577927296:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.208560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.208616:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928704 00000100:00100000:2.0:1787599367.208623:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928704 00000100:00100000:2.0:1787599367.208663:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928064 00000100:00100000:2.0:1787599367.208665:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928064 00000100:00100000:2.0:1787599367.208679:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928576 00000100:00100000:2.0:1787599367.208681:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928576 00000100:00100000:2.0:1787599367.208694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599367.208701:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577928192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.208753:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577928192:12345-0@lo:400:kworker.0 Request processed in 52us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.208760:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599367.208773:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787599367.208780:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577928704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.208837:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577928704:12345-0@lo:400:kworker.0 Request processed in 57us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.208843:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787599367.208853:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787599367.208860:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577928064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.208892:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577928064:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.208898:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787599367.208909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599367.208915:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577928576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.208941:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577928576:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.208947:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787599367.208990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599367.208995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599367.209050:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577927168:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.209067:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577927680:0@lo:400:kworker.0 00010000:00080000:2.0:1787599367.209083:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8a80 x1874433577928192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.209094:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577928192:0@lo:400:kworker.0 00010000:00080000:2.0:1787599367.209106:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8700 x1874433577928704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.209114:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577928704:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.216453:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577927808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.216542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599367.220265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927552 00000100:00100000:1.0:1787599367.220286:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927552 00000100:00100000:0.0:1787599367.221696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577928320:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.221767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599367.221788:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577928832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599367.221843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.223883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.223927:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577928448:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.223976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.224010:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577928960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599367.224041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.224085:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577927424:0@lo:400:kworker.0 00000100:00100000:2.0:1787599367.224123:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928832 00000100:00100000:2.0:1787599367.224129:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928832 00000100:00100000:2.0:1787599367.224183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928960 00000100:00100000:2.0:1787599367.224187:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928960 00000100:00100000:2.0:1787599367.224215:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599367.224224:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577928832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599367.224259:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599367.224298:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577928832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (2454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.224569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599367.224590:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787599367.224597:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577928960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599367.224609:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599367.224641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927296 00000100:00100000:2.0:1787599367.224641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577928960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.224646:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927296 00000100:00100000:2.0:1787599367.224648:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787599367.224671:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927808 00000100:00100000:3.0:1787599367.224675:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927808 00010000:00080000:2.0:1787599367.224676:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138e680 x1874433577928960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.224692:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577928960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599367.224697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928320 00000100:00100000:3.0:1787599367.224700:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928320 00000100:00100000:3.0:1787599367.224712:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577927936 00000100:00100000:3.0:1787599367.224714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577927936 00010000:00080000:2.0:1787599367.224722:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fad80 x1874433577928064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599367.224724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577928448 00000100:00100000:3.0:1787599367.224726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577928448 00000100:00100000:2.0:1787599367.224732:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577928064:0@lo:400:kworker.0 00000100:00100000:3.0:1787599367.224737:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599367.224742:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577927296:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787599367.224744:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fb480 x1874433577928576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.224752:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577928576:0@lo:400:kworker.0 00000100:00100000:3.0:1787599367.224783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577927296:12345-0@lo:400:kworker.0 Request processed in 41us (16223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.224805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599367.224818:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599367.224824:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577927808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787599367.224837:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599367.224842:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599367.224852:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577927808:12345-0@lo:400:kworker.0 Request processed in 29us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.224858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599367.224869:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787599367.224875:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577928320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599367.224903:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577928320:12345-0@lo:400:kworker.0 Request processed in 29us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.224908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787599367.224919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787599367.224925:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577927936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599367.224964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577927936:12345-0@lo:400:kworker.0 Request processed in 39us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.224970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787599367.224980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787599367.224986:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577928448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599367.225075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577928448:12345-0@lo:400:kworker.0 Request processed in 89us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599367.225081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1787599367.226559:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fbb80 x1874433577927936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.226576:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577927936:0@lo:400:kworker.0 00010000:00080000:2.0:1787599367.226590:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8380 x1874433577928448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.226618:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577928448:0@lo:400:kworker.0 00000100:00100000:1.0:1787599367.229723:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599367.229743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577927552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599367.229898:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577927552:12345-0@lo:400:kworker.0 Request processed in 160us (23289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599367.229914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599367.229965:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577927552:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.230424:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577927296:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.230440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577927808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599367.230449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577928320:0@lo:400:kworker.0 00010000:00080000:0.0:1787599367.230460:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ae680 x1874433577928832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599367.230476:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577928832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787599367.401465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599367.717832:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577929088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599367.717928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.718012:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929088 00000100:00100000:2.0:1787599367.718020:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929088 00000100:00100000:2.0:1787599367.718068:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787599367.718077:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577929088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599367.718106:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599367.718146:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577929088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.718152:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787599367.718192:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138e680 x1874433577929088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.718210:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577929088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599367.718440:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599367.718450:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577929216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599367.718476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599367.718508:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929216 00000100:00100000:2.0:1787599367.718512:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929216 00000100:00100000:2.0:1787599367.718535:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599367.718541:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577929216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599367.718552:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599367.718582:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577929216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599367.718597:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787599367.718624:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8380 x1874433577929216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599367.718636:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577929216:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787599368.421005:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599368.741228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577929344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599368.741361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599368.741491:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929344 00000100:00100000:2.0:1787599368.741502:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929344 00000100:00100000:2.0:1787599368.741563:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787599368.741574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577929344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599368.741617:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599368.742536:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577929344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 957us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599368.742548:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787599368.748946:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577929344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787599369.447645:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599370.282520:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577929472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599370.282608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599370.282720:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929472 00000100:00100000:0.0:1787599370.282733:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929472 00000100:00100000:0.0:1787599370.282829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787599370.282841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577929472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599370.282881:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599370.282936:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577929472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599370.282944:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787599370.283009:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577929472:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599370.470154:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599371.212648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599371.212688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599371.212713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599371.214036:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980864 00000100:00100000:3.0:1787599371.214055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980864 00000100:00100000:3.0:1787599371.214113:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980992 00000100:00100000:3.0:1787599371.214116:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980992 00000100:00100000:3.0:1787599371.214155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1787599371.214166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558980864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599371.214251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558980864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599371.214259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1787599371.214281:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1787599371.214289:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558980992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599371.214315:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558980992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599371.214321:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00080000:3.0:1787599371.214849:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599371.214855:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599371.217849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558980736 00000100:00100000:1.0:1787599371.217871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558980736 00000100:00100000:1.0:1787599371.217949:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 288 00000100:00100000:1.0:1787599371.217973:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558980736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599371.218072:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2404:x1874433558980736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 112us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599371.218081:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 288 00010000:00010000:1.0:1787599371.494036:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599372.325159:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577929600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599372.325234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.325317:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929600 00000100:00100000:0.0:1787599372.325325:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929600 00000100:00100000:0.0:1787599372.325378:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599372.325387:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577929600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599372.325417:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599372.325454:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577929600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.325460:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787599372.325491:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599372.325519:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436fad80 x1874433577929600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599372.325537:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577929600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599372.325908:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577929856:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.325946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326009:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577930368:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577930880:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326090:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599372.326094:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577929984:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577930496:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326169:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326185:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577931008:0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599372.326229:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930368 00000100:00100000:2.0:1787599372.326234:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930368 00000100:00100000:2.0:1787599372.326264:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787599372.326271:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577930368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.326313:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577930368:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599372.326319:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787599372.326349:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577930368:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326550:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577930112:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326604:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577930624:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326637:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577931136:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326679:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787599372.326685:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577929728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599372.326708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326725:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577930240:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577930752:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326789:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577931264:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.326841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.326869:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931136 00000100:00100000:0.0:1787599372.326874:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931136 00000100:00100000:0.0:1787599372.326908:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930752 00000100:00100000:0.0:1787599372.326911:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930752 00000100:00100000:0.0:1787599372.326925:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931264 00000100:00100000:0.0:1787599372.326927:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931264 00000100:00100000:0.0:1787599372.326940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599372.326970:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577931136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.327008:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577931136:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.327014:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599372.327028:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599372.327034:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577930752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.327061:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577930752:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.327067:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599372.327077:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599372.327083:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577931264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.327109:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577931264:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.327128:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787599372.327247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930880 00000100:00100000:1.0:1787599372.327253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930880 00000100:00100000:1.0:1787599372.327276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929984 00000100:00100000:1.0:1787599372.327279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929984 00000100:00100000:1.0:1787599372.327289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930496 00000100:00100000:1.0:1787599372.327292:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930496 00000100:00100000:1.0:1787599372.327302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931008 00000100:00100000:1.0:1787599372.327305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931008 00000100:00100000:1.0:1787599372.327315:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930624 00000100:00100000:1.0:1787599372.327317:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930624 00000100:00100000:1.0:1787599372.327326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930240 00000100:00100000:1.0:1787599372.327335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930240 00000100:00100000:1.0:1787599372.327352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599372.327358:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577930880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327400:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577930880:12345-0@lo:400:kworker.0 Request processed in 42us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327406:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599372.327419:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787599372.327425:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577929984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577929984:12345-0@lo:400:kworker.0 Request processed in 27us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787599372.327468:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787599372.327474:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577930496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327499:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577930496:12345-0@lo:400:kworker.0 Request processed in 27us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787599372.327516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599372.327522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577931008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327548:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577931008:12345-0@lo:400:kworker.0 Request processed in 27us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599372.327564:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599372.327570:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577930624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327597:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577930624:12345-0@lo:400:kworker.0 Request processed in 27us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599372.327626:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787599372.327632:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577930240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577930240:12345-0@lo:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599372.327666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787599372.327697:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577929984:0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327707:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577930496:0@lo:400:kworker.0 00010000:00080000:1.0:1787599372.327719:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84ce00 x1874433577931008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.327730:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577931008:0@lo:400:kworker.0 00000100:00100000:1.0:1787599372.327740:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577930880:0@lo:400:kworker.0 00000100:00080000:1.0:1787599372.327823:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599372.327828:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599372.327830:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599372.327832:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599372.327865:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577930240:0@lo:400:kworker.0 00010000:00080000:1.0:1787599372.327876:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84c380 x1874433577930752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.327885:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577930752:0@lo:400:kworker.0 00010000:00080000:1.0:1787599372.327894:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84d880 x1874433577931264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.327903:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577931264:0@lo:400:kworker.0 00010000:00080000:1.0:1787599372.327921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84fb80 x1874433577930624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.327930:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577930624:0@lo:400:kworker.0 00010000:00080000:1.0:1787599372.327941:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84df80 x1874433577931136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.327948:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577931136:0@lo:400:kworker.0 00000100:00100000:3.0:1787599372.328136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929856 00000100:00100000:3.0:1787599372.328150:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929856 00000100:00100000:3.0:1787599372.328191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787599372.328198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577929856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599372.328239:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577929856:12345-0@lo:400:kworker.0 Request processed in 42us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599372.328245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787599372.328292:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577929856:0@lo:400:kworker.0 00000100:00100000:0.0:1787599372.328598:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577929728 00000100:00100000:0.0:1787599372.328604:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577929728 00000100:00100000:0.0:1787599372.328630:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599372.328635:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577929728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599372.328653:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599372.328698:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577929728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.328703:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787599372.328729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8700 x1874433577929728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599372.328744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577929728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599372.328828:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577930112 00000100:00100000:2.0:1787599372.328833:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577930112 00000100:00100000:2.0:1787599372.328862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599372.328868:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577930112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599372.328906:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577930112:12345-0@lo:400:kworker.0 Request processed in 38us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599372.328912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599372.329106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577930112:0@lo:400:kworker.0 00010000:00010000:2.0:1787599372.517044:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599372.837412:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599372.837445:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577931392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599372.837523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599372.837726:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577931520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599372.837753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599372.837842:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931392 00000100:00100000:0.0:1787599372.837852:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931392 00000100:00100000:0.0:1787599372.837906:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931520 00000100:00100000:0.0:1787599372.837910:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931520 00000100:00100000:0.0:1787599372.837926:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599372.837935:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577931392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599372.838003:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599372.838052:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577931392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.838060:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599372.838077:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599372.838083:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577931520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599372.838091:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599372.838115:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577931520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599372.838120:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787599372.838253:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e7480 x1874433577931520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.838271:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577931520:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787599372.838281:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ea00 x1874433577931392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599372.838290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577931392:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787599373.541192:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599373.861457:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577931648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599373.861551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599373.861702:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931648 00000100:00100000:2.0:1787599373.861712:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931648 00000100:00100000:2.0:1787599373.861777:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787599373.861789:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35ab9d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577931648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599373.861846:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599373.861933:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35ab9d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577931648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599373.861949:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599373.861979:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577931648:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599374.566565:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599374.771204:0:11997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:22:53 (1787599373) === 00000100:00100000:2.0:1787599375.156890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.157136:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981120 00000100:00100000:1.0:1787599375.157159:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981120 00000100:00100000:1.0:1787599375.157239:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:1.0:1787599375.157252:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:8727:x1874433558981120:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599375.157273:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599375.157293:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf3bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba16 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599375.157343:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf3bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba16 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599375.157354:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf3bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba16 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599375.157363:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031e00, rc 0) 00000100:00100000:1.0:1787599375.158363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981120:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 1103us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.158376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:0.0:1787599375.168368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.177025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981248 00000100:00100000:1.0:1787599375.177044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981248 00000100:00100000:1.0:1787599375.177128:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:1.0:1787599375.177150:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981248:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787599375.177825:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981248:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 649us (9431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.177836:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:0.0:1787599375.181062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.185067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981376 00000100:00100000:1.0:1787599375.185091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981376 00000100:00100000:1.0:1787599375.185202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:1.0:1787599375.185215:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981376:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599375.185435:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981376:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 220us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.185453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:2.0:1787599375.192967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.193326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981504 00000100:00100000:3.0:1787599375.193338:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981504 00000100:00100000:3.0:1787599375.193406:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:3.0:1787599375.193417:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981504:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599375.193623:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981504:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 206us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.193632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:1.0:1787599375.222720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599375.222957:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981632 00000100:00100000:2.0:1787599375.222971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981632 00000100:00100000:2.0:1787599375.223038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:2.0:1787599375.223048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981632:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599375.223282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981632:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599375.223289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:0.0:1787599375.227782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.228995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981760 00000100:00100000:1.0:1787599375.229013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981760 00000100:00100000:1.0:1787599375.229090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:1.0:1787599375.229102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981760:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599375.229315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8731:x1874433558981760:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 214us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.229323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:1.0:1787599375.233178:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599375.233335:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558981888 00000100:00100000:2.0:1787599375.233347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558981888 00000100:00100000:2.0:1787599375.233410:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:2.0:1787599375.233421:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:8727:x1874433558981888:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599375.233440:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599375.233463:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7200/0x5d2988b0929cf3c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.233495:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7200/0x5d2988b0929cf3c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba47 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.233506:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7200/0x5d2988b0929cf3c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba47 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.233518:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7200, rc 0) 00000100:00100000:2.0:1787599375.233616:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:8727:x1874433558981888:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 195us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599375.233623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:0.0:1787599375.239016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.239117:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982016 00000100:00100000:3.0:1787599375.239127:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982016 00000100:00100000:3.0:1787599375.239188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:3.0:1787599375.239198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:8727:x1874433558982016:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787599375.239226:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787599375.239252:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787599375.239257:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787599375.239260:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787599375.239263:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787599375.239265:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787599375.241656:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:8727:x1874433558982016:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 2445us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.241675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:1.0:1787599375.245373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599375.245492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982144 00000100:00100000:2.0:1787599375.245505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982144 00000100:00100000:2.0:1787599375.245575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:2.0:1787599375.245586:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:8727:x1874433558982144:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599375.245603:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599375.245620:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba4e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.245649:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.245660:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599375.245669:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6200, rc 0) 00000100:00100000:2.0:1787599375.245741:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8727:x1874433558982144:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599375.245748:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:0.0:1787599375.252177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.252447:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982272 00000100:00100000:3.0:1787599375.252465:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982272 00000100:00100000:3.0:1787599375.252573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:3.0:1787599375.252585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8727:x1874433558982272:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787599375.252752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8727:x1874433558982272:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 168us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.252778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:0.0:1787599375.256011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.256596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982400 00000100:00100000:1.0:1787599375.256607:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982400 00000100:00100000:1.0:1787599375.256726:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:1.0:1787599375.256738:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8727:x1874433558982400:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599375.256946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8727:x1874433558982400:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 209us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.256954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:1.0:1787599375.262717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.264839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982528 00000100:00100000:3.0:1787599375.264861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982528 00000100:00100000:2.0:1787599375.265074:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:2.0:1787599375.265085:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8736:x1874433558982528:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599375.265281:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8736:x1874433558982528:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 197us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599375.265287:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:0.0:1787599375.275657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.280214:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982656 00000100:00100000:1.0:1787599375.280236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982656 00000100:00100000:1.0:1787599375.280391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:1.0:1787599375.280403:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8736:x1874433558982656:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599375.280643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:8736:x1874433558982656:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 241us (4999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599375.280651:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:0.0:1787599375.286940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.286986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.287005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.287027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.287056:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982784 00000100:00100000:0.0:1787599375.287066:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982784 00000100:00100000:0.0:1787599375.287106:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983040 00000100:00100000:0.0:1787599375.287109:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983040 00000100:00100000:0.0:1787599375.287115:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983424 00000100:00100000:0.0:1787599375.287117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983424 00000100:00100000:0.0:1787599375.287153:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983552 00000100:00100000:0.0:1787599375.287155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983552 00000100:00100000:0.0:1787599375.287171:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1787599375.287180:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558983424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599375.287255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558983424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.287262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1787599375.287277:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1787599375.287282:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558983552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599375.287303:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558983552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.287309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1787599375.287317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1787599375.287321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433558982784:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787599375.287343:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e17efe0f-8a41-4104-9ca3-3518d13d3cfe@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1787599375.287376:0:6522:0:(genops.c:1385:class_connect()) connect: client e17efe0f-8a41-4104-9ca3-3518d13d3cfe, cookie 0x5d2988b0929cf3d2 00000004:00100000:0.0:1787599375.287401:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787599375.287547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1787599375.287553:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1874433558983040:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787599375.287569:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e17efe0f-8a41-4104-9ca3-3518d13d3cfe@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:3.0:1787599375.287592:0:6520:0:(genops.c:1385:class_connect()) connect: client e17efe0f-8a41-4104-9ca3-3518d13d3cfe, cookie 0x5d2988b0929cf3d9 00000004:00100000:3.0:1787599375.287605:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787599375.287704:0:6520:0:(import.c:65:import_set_state_nolock()) ffff96b2430ba000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599375.287734:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2402:x1874433558983040:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 181us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.287741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:0.0:1787599375.288070:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96b243358000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599375.288310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2402:x1874433558982784:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 983us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.288319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00080000:2.0:1787599375.293022:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599375.293051:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599375.297432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.299057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.299128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558982912 00000100:00100000:3.0:1787599375.299140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558982912 00000100:00100000:3.0:1787599375.299203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983296 00000100:00100000:3.0:1787599375.299206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983296 00000100:00100000:3.0:1787599375.299228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599375.299239:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+7:0:x1874433558982912:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599375.299286:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599375.299397:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+7:0:x1874433558982912:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 159us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.299405:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599375.299424:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599375.299447:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558983296:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599375.299460:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599375.299484:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558983296:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.299490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00080000:2.0:1787599375.299684:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599375.301357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.301571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983168 00000100:00100000:3.0:1787599375.301584:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983168 00000100:00100000:3.0:1787599375.301671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1787599375.301683:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:0:x1874433558983168:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599375.301733:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1787599375.301934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599375.302125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:0:x1874433558983168:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 444us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.302134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599375.305915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599375.306098:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983680 00000100:00100000:3.0:1787599375.306107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983680 00000100:00100000:3.0:1787599375.306160:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1787599375.306174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558983680:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787599375.306263:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558983680:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 92us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599375.306271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599375.308301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.308345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599375.308485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.309875:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983808 00000100:00100000:0.0:1787599375.309895:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983808 00000100:00100000:0.0:1787599375.309948:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558983936 00000100:00100000:0.0:1787599375.309952:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558983936 00000100:00100000:0.0:1787599375.309987:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599375.309999:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874433558983808:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787599375.310041:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e17efe0f-8a41-4104-9ca3-3518d13d3cfe@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1787599375.310078:0:8435:0:(genops.c:1385:class_connect()) connect: client e17efe0f-8a41-4104-9ca3-3518d13d3cfe, cookie 0x5d2988b0929cf3e0 00002000:00100000:0.0:1787599375.310104:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e17efe0f-8a41-4104-9ca3-3518d13d3cfe/ffff96b24335b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787599375.310129:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787599375.310232:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787599375.310268:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96b243359000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599375.310341:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2402:x1874433558983808:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 344us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.310347:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599375.310361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1787599375.310364:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874433558983936:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787599375.310378:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e17efe0f-8a41-4104-9ca3-3518d13d3cfe@192.168.202.1@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1787599375.310395:0:8435:0:(genops.c:1385:class_connect()) connect: client e17efe0f-8a41-4104-9ca3-3518d13d3cfe, cookie 0x5d2988b0929cf3e7 00002000:00100000:0.0:1787599375.310416:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e17efe0f-8a41-4104-9ca3-3518d13d3cfe/ffff96b24335d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787599375.310428:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787599375.311130:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787599375.311159:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96b24335a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599375.311199:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2402:x1874433558983936:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 830us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.311207:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599375.316886:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984064 00000100:00100000:2.0:1787599375.316903:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984064 00000100:00100000:2.0:1787599375.316988:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599375.317000:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558984064:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787599375.317721:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558984064:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 720us (9371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599375.317732:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599375.323524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599375.324137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984192 00000100:00100000:0.0:1787599375.324148:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984192 00000100:00100000:0.0:1787599375.324207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1787599375.324216:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558984192:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787599375.324299:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787599375.324371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:8727:x1874433558984192:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 155us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.324379:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1787599375.398199:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599375.398226:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577931776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599375.398351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599375.399073:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931776 00000100:00100000:0.0:1787599375.399083:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931776 00000100:00100000:0.0:1787599375.399150:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599375.399161:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577931776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599375.399197:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599375.399267:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577931776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599375.399275:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599375.399461:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577931776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599375.589082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599376.616960:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599377.445286:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577932032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599377.445356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599377.445425:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599377.445431:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577931904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599377.445453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599377.445486:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932032 00000100:00100000:1.0:1787599377.445493:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932032 00000100:00100000:1.0:1787599377.445541:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577931904 00000100:00100000:1.0:1787599377.445544:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577931904 00000100:00100000:1.0:1787599377.445562:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599377.445570:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577932032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599377.445600:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599377.445646:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577932032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599377.445652:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599377.445669:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599377.445675:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577931904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599377.445684:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599377.445705:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577931904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599377.445711:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787599377.445726:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599377.445759:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e5f80 x1874433577931904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599377.445777:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577931904:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787599377.445830:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435af100 x1874433577932032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599377.445841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577932032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599377.463652:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577932288:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.463723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.463771:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577932800:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.463819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.463846:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577933312:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.463874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.463905:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787599377.463922:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577932160:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.463950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.463975:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577932672:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.463998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.464017:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577933184:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.464043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577932416:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465324:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577932928:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465373:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577933440:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465419:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599377.465425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577932544:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465457:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577933056:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599377.465513:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932288 00000100:00100000:2.0:1787599377.465522:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932288 00000100:00100000:2.0:1787599377.465562:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932800 00000100:00100000:2.0:1787599377.465566:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932800 00000100:00100000:2.0:1787599377.465591:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933184 00000100:00100000:2.0:1787599377.465594:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933184 00000100:00100000:2.0:1787599377.465612:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932928 00000100:00100000:2.0:1787599377.465615:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932928 00000100:00100000:2.0:1787599377.465625:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932544 00000100:00100000:2.0:1787599377.465627:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932544 00000100:00100000:2.0:1787599377.465635:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933056 00000100:00100000:2.0:1787599377.465637:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933056 00000100:00100000:2.0:1787599377.465651:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787599377.465659:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577932288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465721:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577932288:12345-0@lo:400:kworker.0 Request processed in 62us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.465729:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787599377.465749:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599377.465763:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577932800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465820:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577932800:12345-0@lo:400:kworker.0 Request processed in 57us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.465826:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599377.465838:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599377.465844:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465874:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577933184:12345-0@lo:400:kworker.0 Request processed in 29us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.465879:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599377.465891:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787599377.465897:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577932928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465940:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577932928:12345-0@lo:400:kworker.0 Request processed in 42us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.465946:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787599377.465959:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787599377.465965:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577932544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.465990:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577932544:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.465996:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787599377.466006:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787599377.466011:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577933056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.466034:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577933056:12345-0@lo:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.466039:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787599377.466063:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933312 00000100:00100000:3.0:1787599377.466203:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932672 00000100:00100000:3.0:1787599377.466209:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932672 00000100:00100000:3.0:1787599377.466242:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932416 00000100:00100000:3.0:1787599377.466245:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932416 00000100:00100000:3.0:1787599377.466259:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599377.466265:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577932672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599377.466305:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577932672:12345-0@lo:400:kworker.0 Request processed in 40us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599377.466312:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599377.466325:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599377.466331:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577932416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599377.466357:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577932416:12345-0@lo:400:kworker.0 Request processed in 28us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599377.466363:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599377.467560:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933440 00000100:00100000:3.0:1787599377.467572:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933440 00000100:00100000:3.0:1787599377.467625:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599377.467637:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577933440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599377.467705:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577933440:12345-0@lo:400:kworker.0 Request processed in 71us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599377.467711:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599377.467745:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577932160 00000100:00100000:3.0:1787599377.467749:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577932160 00000100:00100000:3.0:1787599377.467778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787599377.467784:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577932160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599377.467832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577932160:12345-0@lo:400:kworker.0 Request processed in 49us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599377.467854:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787599377.469968:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933312 00000100:00100000:2.0:1787599377.470046:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599377.470056:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577933312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470162:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577933312:12345-0@lo:400:kworker.0 Request processed in 107us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599377.470169:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787599377.470192:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599377.470197:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599377.470200:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599377.470234:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577932160:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470251:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577932672:0@lo:400:kworker.0 00010000:00080000:2.0:1787599377.470267:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afd880 x1874433577933184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599377.470277:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577933184:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470289:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577932288:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470302:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577932800:0@lo:400:kworker.0 00010000:00080000:2.0:1787599377.470311:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afe680 x1874433577933312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599377.470318:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577933312:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470361:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577932544:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470373:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577933056:0@lo:400:kworker.0 00000100:00100000:2.0:1787599377.470384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577932416:0@lo:400:kworker.0 00010000:00080000:2.0:1787599377.470407:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377aff800 x1874433577932928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599377.470415:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577932928:0@lo:400:kworker.0 00010000:00080000:2.0:1787599377.470426:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afea00 x1874433577933440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599377.470434:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577933440:0@lo:400:kworker.0 00010000:00010000:0.0:1787599377.642744:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599377.957004:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577933568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599377.957104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599377.957197:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577933696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599377.957223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599377.957261:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933568 00000100:00100000:1.0:1787599377.957269:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933568 00000100:00100000:1.0:1787599377.957315:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933696 00000100:00100000:1.0:1787599377.957319:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933696 00000100:00100000:1.0:1787599377.957333:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599377.957342:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577933568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599377.957375:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599377.957607:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577933568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599377.957617:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599377.957635:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599377.957652:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577933696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599377.957665:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599377.957698:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577933696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599377.957704:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787599377.957747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b2680 x1874433577933696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599377.957789:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577933696:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787599377.957865:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435af100 x1874433577933568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599377.957881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577933568:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787599378.662292:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599378.981329:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577933824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599378.981412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599378.981610:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933824 00000100:00100000:3.0:1787599378.981619:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933824 00000100:00100000:3.0:1787599378.981673:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599378.981683:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577933824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599378.981719:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599378.981766:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577933824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599378.981774:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787599378.982569:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577933824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599379.685365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599380.423463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599380.423689:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984576 00000100:00100000:3.0:1787599380.423698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984576 00000100:00100000:3.0:1787599380.423747:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984832 00000100:00100000:3.0:1787599380.423750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984832 00000100:00100000:3.0:1787599380.423764:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984448 00000100:00100000:3.0:1787599380.423767:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984448 00000100:00100000:3.0:1787599380.423777:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984704 00000100:00100000:3.0:1787599380.423779:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984704 00000100:00100000:3.0:1787599380.423823:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:3.0:1787599380.423835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558984576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.423923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558984576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.423948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:3.0:1787599380.423964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1787599380.423970:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.423994:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.424000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1787599380.424010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1787599380.424015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558984448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.424035:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433558984448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.424041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1787599380.424180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:3.0:1787599380.424188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.424216:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.424221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:3.0:1787599380.424242:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985088 00000100:00100000:3.0:1787599380.424246:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985088 00000100:00100000:3.0:1787599380.424271:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984960 00000100:00100000:3.0:1787599380.424273:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984960 00000100:00100000:3.0:1787599380.424291:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599380.424298:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558985088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.424324:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558985088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.424338:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599380.424350:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1787599380.424356:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599380.424380:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2405:x1874433558984960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599380.424386:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1787599380.424492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558984320 00000100:00100000:2.0:1787599380.424497:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558984320 00000100:00100000:2.0:1787599380.424536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00100000:2.0:1787599380.424543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433558984320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599380.424570:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433558984320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.424577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00080000:2.0:1787599380.424617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599380.424621:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599380.424624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599380.424627:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599380.520415:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599380.520444:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577933952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599380.520527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599380.523191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577933952 00000100:00100000:0.0:1787599380.523213:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577933952 00000100:00100000:0.0:1787599380.523343:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787599380.523356:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577933952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599380.523405:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599380.523507:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577933952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599380.523515:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787599380.523575:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577933952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599380.708965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599381.367179:0:12190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1787599381.543209:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00100000:0.0:1787599381.552699:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00100000:3.0:1787599381.554193:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00100000:2.0:1787599381.559319:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00010000:00010000:0.0:1787599381.733899:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599382.565322:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577934464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565472:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577934976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565540:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577935488:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565585:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787599382.565591:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577934080:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565644:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577934592:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565682:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577935104:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565709:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577935616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565748:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577934336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565783:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577934848:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565823:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565836:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577935360:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565877:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787599382.565883:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577934208:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565922:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577934720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.565951:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577935232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.565978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.566005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934080 00000100:00100000:2.0:1787599382.566013:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934080 00000100:00100000:2.0:1787599382.566064:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787599382.566074:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577934080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.566123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577934080:12345-0@lo:400:kworker.0 Request processed in 50us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.566131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787599382.566164:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934592 00000100:00100000:2.0:1787599382.566168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934592 00000100:00100000:2.0:1787599382.566190:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934336 00000100:00100000:2.0:1787599382.566193:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934336 00000100:00100000:2.0:1787599382.566207:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787599382.566212:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.566246:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577934592:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.566253:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787599382.566264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599382.566270:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577934336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.566302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577934336:12345-0@lo:400:kworker.0 Request processed in 32us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.566307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599382.566345:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577934336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.566371:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577934080:0@lo:400:kworker.0 00000100:00100000:2.0:1787599382.566380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577934592:0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934464 00000100:00100000:3.0:1787599382.566590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934464 00000100:00100000:3.0:1787599382.566612:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934848 00000100:00100000:3.0:1787599382.566615:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934848 00000100:00100000:3.0:1787599382.566634:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935360 00000100:00100000:3.0:1787599382.566637:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935360 00000100:00100000:3.0:1787599382.566649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934208 00000100:00100000:3.0:1787599382.566652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934208 00000100:00100000:3.0:1787599382.566660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934720 00000100:00100000:3.0:1787599382.566663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934720 00000100:00100000:3.0:1787599382.566673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935232 00000100:00100000:3.0:1787599382.566675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935232 00000100:00100000:3.0:1787599382.566688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787599382.566695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577934464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577934464:12345-0@lo:400:kworker.0 Request processed in 42us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.566744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787599382.566763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787599382.566771:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577934848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566823:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577934848:12345-0@lo:400:kworker.0 Request processed in 53us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.566830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787599382.566841:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599382.566848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577935360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566891:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577935360:12345-0@lo:400:kworker.0 Request processed in 43us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.566898:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599382.566908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787599382.566915:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577934208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577934208:12345-0@lo:400:kworker.0 Request processed in 26us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.566945:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787599382.566955:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787599382.566961:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577934720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.566986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577934720:12345-0@lo:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.566991:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787599382.567002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787599382.567008:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577935232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577935232:12345-0@lo:400:kworker.0 Request processed in 37us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.567050:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787599382.567075:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577934976 00000100:00100000:3.0:1787599382.567079:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577934976 00000100:00100000:3.0:1787599382.567097:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935488 00000100:00100000:3.0:1787599382.567100:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935488 00000100:00100000:3.0:1787599382.567110:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935104 00000100:00100000:3.0:1787599382.567112:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935104 00000100:00100000:3.0:1787599382.567123:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935616 00000100:00100000:3.0:1787599382.567125:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935616 00000100:00100000:3.0:1787599382.567136:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787599382.567142:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577934976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567171:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577934976:12345-0@lo:400:kworker.0 Request processed in 29us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.567177:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787599382.567186:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599382.567192:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577935488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567219:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577935488:12345-0@lo:400:kworker.0 Request processed in 27us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.567224:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599382.567234:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787599382.567241:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577935104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567265:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577935104:12345-0@lo:400:kworker.0 Request processed in 26us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.567270:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787599382.567281:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599382.567287:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577935616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567311:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577935616:12345-0@lo:400:kworker.0 Request processed in 24us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.567326:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599382.567378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577934208:0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567388:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577934720:0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577935232:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567407:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afed80 x1874433577934848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567418:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577934848:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567428:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ea00 x1874433577935360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567435:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577935360:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567469:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377affb80 x1874433577935104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567477:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577935104:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567488:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2c700 x1874433577935616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577935616:0@lo:400:kworker.0 00000100:00100000:3.0:1787599382.567507:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577934464:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567517:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afd880 x1874433577934976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577934976:0@lo:400:kworker.0 00010000:00080000:3.0:1787599382.567545:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2ce00 x1874433577935488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.567552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577935488:0@lo:400:kworker.0 00000100:00080000:2.0:1787599382.567703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599382.567707:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599382.567710:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599382.567711:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599382.569909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599382.569975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599382.570111:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935744 00000100:00100000:0.0:1787599382.570118:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935744 00000100:00100000:0.0:1787599382.570165:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787599382.570174:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577935744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599382.570286:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599382.570338:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577935744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599382.570346:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787599382.570418:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e5880 x1874433577935744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599382.570436:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599382.570770:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577935872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599382.570844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599382.571007:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577935872 00000100:00100000:1.0:1787599382.571013:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577935872 00000100:00100000:1.0:1787599382.571065:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599382.571073:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577935872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599382.571086:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599382.574378:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577935872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3296us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599382.574394:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787599382.574744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b241090e00 x1874433577935872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599382.574768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577935872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787599382.757939:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599383.078328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599383.078355:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577936000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599383.078644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599383.078735:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936000 00000100:00100000:1.0:1787599383.078930:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936000 00000100:00100000:1.0:1787599383.078994:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599383.079003:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577936000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599383.079124:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599383.079136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577936128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599383.079172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787599383.079301:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599383.079345:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577936000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 342us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599383.079352:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599383.079382:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936128 00000100:00100000:1.0:1787599383.079386:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936128 00000100:00100000:1.0:1787599383.079401:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599383.079407:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577936128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599383.079419:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599383.080350:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577936128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 903us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599383.080386:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787599383.080517:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b3100 x1874433577936000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787599383.080948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e6a00 x1874433577936128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599383.080968:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577936128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599383.083166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577936000:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787599383.782761:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599384.121299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577936256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599384.121386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599384.121477:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936256 00000100:00100000:1.0:1787599384.121493:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936256 00000100:00100000:1.0:1787599384.121557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599384.121566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577936256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599384.121611:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787599384.121661:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577936256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599384.121668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599384.121722:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577936256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787599384.811610:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599385.549159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599385.549324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599385.549392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985472 00000100:00100000:0.0:1787599385.549404:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985472 00000100:00100000:0.0:1787599385.549462:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985728 00000100:00100000:0.0:1787599385.549465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985728 00000100:00100000:0.0:1787599385.549479:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985344 00000100:00100000:0.0:1787599385.549482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985344 00000100:00100000:0.0:1787599385.549494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985600 00000100:00100000:0.0:1787599385.549496:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985600 00000100:00100000:0.0:1787599385.549523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:0.0:1787599385.549534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558985472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599385.549614:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558985472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.549637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:0.0:1787599385.549655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:0.0:1787599385.549662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599385.549859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.549868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:0.0:1787599385.549883:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:0.0:1787599385.549890:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558985344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599385.549914:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433558985344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.549919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:0.0:1787599385.549929:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:0.0:1787599385.549934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599385.549955:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.549960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1787599385.550148:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985216 00000100:00100000:3.0:1787599385.550153:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985216 00000100:00100000:3.0:1787599385.550191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:3.0:1787599385.550199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433558985216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599385.550231:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433558985216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.550237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:3.0:1787599385.550265:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985984 00000100:00100000:3.0:1787599385.550269:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985984 00000100:00100000:3.0:1787599385.550290:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558985856 00000100:00100000:3.0:1787599385.550292:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558985856 00000100:00100000:3.0:1787599385.550310:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1787599385.550317:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599385.550342:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.550359:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1787599385.550371:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1787599385.550376:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599385.550398:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558985856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.550403:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00080000:1.0:1787599385.551546:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599385.551554:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599385.551556:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599385.551558:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599385.637892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599385.637922:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577936384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599385.638011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599385.638284:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936384 00000100:00100000:0.0:1787599385.638296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936384 00000100:00100000:0.0:1787599385.638366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787599385.638379:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577936384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599385.638417:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599385.638470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577936384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.638496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787599385.638597:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577936384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787599385.828952:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599386.854606:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599387.685274:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577936512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599387.685359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599387.685437:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936512 00000100:00100000:0.0:1787599387.685445:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936512 00000100:00100000:0.0:1787599387.685504:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599387.685515:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577936512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599387.685547:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599387.685606:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577936512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599387.685615:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787599387.685635:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599387.685667:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2c700 x1874433577936512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599387.685685:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577936512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599387.686841:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599387.686860:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577936640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599387.686908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599387.686961:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936640 00000100:00100000:1.0:1787599387.686967:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936640 00000100:00100000:1.0:1787599387.687023:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599387.687032:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577936640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599387.687050:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599387.687094:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577936640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599387.687100:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1787599387.687128:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e6680 x1874433577936640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599387.687286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577936640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599387.687474:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599387.688680:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577936768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.688751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599387.688887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936768 00000100:00100000:0.0:1787599387.688896:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936768 00000100:00100000:0.0:1787599387.688954:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787599387.688964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577936768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.699974:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577936768:12345-0@lo:400:kworker.0 Request processed in 11001us (11212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599387.699989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787599387.701087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577937024:0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.701184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.703631:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577936768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.703672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599387.703684:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577936896:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.703754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.703862:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577937152:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.703903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.703944:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577936896 00000100:00100000:3.0:1787599387.703953:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577936896 00000100:00100000:3.0:1787599387.704001:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937152 00000100:00100000:3.0:1787599387.704004:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937152 00000100:00100000:3.0:1787599387.704029:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787599387.704039:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577936896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.704097:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577936896:12345-0@lo:400:kworker.0 Request processed in 59us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.704105:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787599387.704123:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599387.704137:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577937152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.704188:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577937152:12345-0@lo:400:kworker.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.704195:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599387.704231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577937152:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.704253:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577936896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.705018:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937024 00000100:00100000:0.0:1787599387.705026:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937024 00000100:00100000:0.0:1787599387.705062:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599387.705071:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577937024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.705125:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577937024:12345-0@lo:400:kworker.0 Request processed in 55us (3941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599387.705132:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599387.705295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577937024:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.706574:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577937280:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.706641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.707023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599387.707031:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577937408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.707082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.707123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937280 00000100:00100000:3.0:1787599387.707129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937280 00000100:00100000:0.0:1787599387.707617:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577937920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.707655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599387.707689:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599387.707694:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577937792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599387.707718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599387.709138:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787599387.709175:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577937280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.709292:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577937280:12345-0@lo:400:kworker.0 Request processed in 138us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.709302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787599387.709339:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937408 00000100:00100000:3.0:1787599387.709348:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937408 00000100:00100000:3.0:1787599387.709398:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937792 00000100:00100000:3.0:1787599387.709403:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937792 00000100:00100000:3.0:1787599387.709437:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787599387.709444:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.709480:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577937408:12345-0@lo:400:kworker.0 Request processed in 37us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.709500:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787599387.709511:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787599387.709517:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577937792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599387.709624:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937920 00000100:00100000:1.0:1787599387.709629:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937920 00000100:00100000:1.0:1787599387.709666:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599387.709675:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577937920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711127:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577937664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599387.711243:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599387.711250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577937536:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599387.711284:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577938048:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599387.711336:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599387.711341:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599387.711345:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599387.711384:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577937408:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577937280:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937664 00000100:00100000:2.0:1787599387.711607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937664 00000100:00100000:2.0:1787599387.711652:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577937536 00000100:00100000:2.0:1787599387.711655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577937536 00000100:00100000:2.0:1787599387.711689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787599387.711698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577937664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.711947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577937664:12345-0@lo:400:kworker.0 Request processed in 248us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.711955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787599387.711973:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787599387.711980:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577937536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.712069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577937536:12345-0@lo:400:kworker.0 Request processed in 89us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.712075:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787599387.712095:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599387.712098:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599387.712116:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a0380 x1874433577937536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599387.712126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577937536:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.712137:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577937664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.712234:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938048 00000100:00100000:2.0:1787599387.712238:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938048 00000100:00100000:2.0:1787599387.712279:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787599387.712287:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577938048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599387.712325:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577938048:12345-0@lo:400:kworker.0 Request processed in 39us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.712331:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787599387.712348:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787599387.712363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370010e00 x1874433577938048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599387.712387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577938048:0@lo:400:kworker.0 00000100:00100000:3.0:1787599387.713119:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577937792:12345-0@lo:400:kworker.0 Request processed in 3598us (5396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.713128:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787599387.713302:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577937920:12345-0@lo:400:kworker.0 Request processed in 3627us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599387.713311:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787599387.717647:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a1c00 x1874433577937792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599387.717672:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577937792:0@lo:400:kworker.0 00010000:00080000:0.0:1787599387.717690:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3480 x1874433577937920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599387.717699:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577937920:0@lo:400:kworker.0 00010000:00010000:0.0:1787599387.888043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599388.197665:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599388.197700:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577938176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599388.197839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599388.198456:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938176 00000100:00100000:1.0:1787599388.198468:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938176 00000100:00100000:1.0:1787599388.198536:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787599388.198548:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577938176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599388.198591:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599388.198660:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377d60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577938176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599388.198681:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787599388.198955:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370012300 x1874433577938176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599388.199513:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599388.199528:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577938304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599388.199571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599388.199573:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577938176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599388.199618:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938304 00000100:00100000:1.0:1787599388.199623:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938304 00000100:00100000:1.0:1787599388.199660:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787599388.200066:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577938304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599388.200088:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599388.200129:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577938304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 461us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599388.200136:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787599388.202535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e6300 x1874433577938304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599388.202563:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577938304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787599388.902135:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599389.221856:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577938432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599389.222020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599389.229710:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938432 00000100:00100000:0.0:1787599389.229727:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938432 00000100:00100000:3.0:1787599389.231344:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787599389.231359:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577938432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599389.231398:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599389.231507:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577938432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (9487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599389.231515:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787599389.232124:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577938432:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1787599389.472224:0:12506:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599389.472561:0:12506:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599389.925033:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599390.670701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599390.670912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986368 00000100:00100000:1.0:1787599390.670922:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986368 00000100:00100000:1.0:1787599390.670982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986624 00000100:00100000:1.0:1787599390.670986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986624 00000100:00100000:1.0:1787599390.671001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986240 00000100:00100000:1.0:1787599390.671004:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986240 00000100:00100000:2.0:1787599390.671153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986112 00000100:00100000:2.0:1787599390.671158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986112 00000100:00100000:2.0:1787599390.671189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:2.0:1787599390.671200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558986112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558986112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671291:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:2.0:1787599390.671338:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:2.0:1787599390.671344:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558986368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558986368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671380:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:2.0:1787599390.671395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1787599390.671401:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1787599390.671454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1787599390.671460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558986240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671484:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558986240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1787599390.671507:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986880 00000100:00100000:2.0:1787599390.671510:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986880 00000100:00100000:2.0:1787599390.671536:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986752 00000100:00100000:2.0:1787599390.671539:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986752 00000100:00100000:2.0:1787599390.671558:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1787599390.671564:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671590:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671597:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1787599390.671608:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1787599390.671614:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599390.671635:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599390.671641:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00080000:2.0:1787599390.671661:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599390.671665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599390.671668:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599390.671670:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599390.672090:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558986496 00000100:00100000:1.0:1787599390.672095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558986496 00000100:00100000:1.0:1787599390.672133:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1787599390.672140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599390.672188:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558986496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599390.672195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00080000:2.0:1787599390.672639:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599390.762239:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577938560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599390.762321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599390.762400:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938560 00000100:00100000:0.0:1787599390.762407:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938560 00000100:00100000:0.0:1787599390.762456:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599390.762465:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577938560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599390.762500:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599390.762545:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577938560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599390.762551:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599390.762595:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577938560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599390.951286:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787599391.676239:0:12603:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599391.677136:0:12603:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599391.974186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599392.808443:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577939072:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.808533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.808596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577939584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.808625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.808645:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577940096:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.808667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.808692:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787599392.808698:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577938688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.808735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.808759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577939200:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.808821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.810061:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577939712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.810104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599392.810288:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939584 00000100:00100000:3.0:1787599392.810298:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939584 00000100:00100000:3.0:1787599392.810357:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940096 00000100:00100000:3.0:1787599392.810360:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940096 00000100:00100000:3.0:1787599392.810373:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939712 00000100:00100000:3.0:1787599392.810375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939712 00000100:00100000:3.0:1787599392.810391:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599392.810399:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577939584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599392.810453:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577939584:12345-0@lo:400:kworker.0 Request processed in 54us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.810461:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599392.810477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599392.810483:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577940096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599392.810522:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577940096:12345-0@lo:400:kworker.0 Request processed in 40us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.810529:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599392.810540:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787599392.810546:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577939712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599392.810571:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577939712:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.810577:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787599392.810594:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599392.810598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599392.810672:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8700 x1874433577939712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.810688:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577939712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.810696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577940224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.810736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787599392.811068:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8a80 x1874433577939584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599392.811070:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939200 00000100:00100000:1.0:1787599392.811075:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939200 00000100:00100000:0.0:1787599392.811079:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577939584:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.811089:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243661180 x1874433577940096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.811097:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577940096:0@lo:400:kworker.0 00000100:00100000:1.0:1787599392.811107:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599392.811113:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577939200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811141:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577938816:0@lo:400:kworker.0 00000100:00100000:1.0:1787599392.811154:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577939200:12345-0@lo:400:kworker.0 Request processed in 41us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599392.811160:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599392.811167:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577939328:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811232:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577939840:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811281:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577940352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599392.811302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811323:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787599392.811329:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577938944:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811367:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577939456:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811403:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577939968:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811429:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577940480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599392.811446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599392.811475:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939072 00000100:00100000:0.0:1787599392.811479:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939072 00000100:00100000:0.0:1787599392.811499:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938816 00000100:00100000:0.0:1787599392.811501:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938816 00000100:00100000:0.0:1787599392.811509:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939328 00000100:00100000:0.0:1787599392.811511:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939328 00000100:00100000:0.0:1787599392.811526:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939840 00000100:00100000:0.0:1787599392.811529:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939840 00000100:00100000:0.0:1787599392.811539:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939456 00000100:00100000:0.0:1787599392.811541:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939456 00000100:00100000:0.0:1787599392.811550:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577939968 00000100:00100000:0.0:1787599392.811553:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577939968 00000100:00100000:0.0:1787599392.811565:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599392.811572:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577939072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811605:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577939072:12345-0@lo:400:kworker.0 Request processed in 33us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.811611:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599392.811630:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599392.811636:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577938816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811667:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577938816:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.811674:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599392.811684:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787599392.811689:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577939328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811714:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577939328:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.811719:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787599392.811728:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787599392.811733:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577939840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.811769:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577939840:12345-0@lo:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.811785:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787599392.811820:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787599392.811837:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577939456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.812367:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577939456:12345-0@lo:400:kworker.0 Request processed in 539us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.812374:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787599392.812388:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787599392.812395:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577939968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.812421:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577939968:12345-0@lo:400:kworker.0 Request processed in 27us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.812426:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787599392.813419:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938944 00000100:00100000:1.0:1787599392.813430:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938944 00000100:00100000:1.0:1787599392.813477:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599392.813486:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577938944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599392.813537:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577938944:12345-0@lo:400:kworker.0 Request processed in 53us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599392.813543:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599392.813566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577938688 00000100:00100000:1.0:1787599392.813569:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577938688 00000100:00100000:1.0:1787599392.813603:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787599392.813611:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577938688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599392.813645:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577938688:12345-0@lo:400:kworker.0 Request processed in 36us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599392.813651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787599392.816684:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940224 00000100:00100000:3.0:1787599392.816699:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940224 00000100:00100000:3.0:1787599392.816783:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599392.816806:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577940224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599392.817186:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577940224:12345-0@lo:400:kworker.0 Request processed in 393us (6448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.817194:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599392.817451:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940352 00000100:00100000:0.0:1787599392.817457:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940352 00000100:00100000:0.0:1787599392.817488:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940480 00000100:00100000:0.0:1787599392.817491:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940480 00000100:00100000:0.0:1787599392.817506:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599392.817513:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577940352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599392.817538:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599392.817576:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577940352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (6273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.817582:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599392.817595:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787599392.817602:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577940480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599392.817615:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599392.817640:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577940480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (6193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.817646:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787599392.817664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599392.817670:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599392.817673:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599392.817702:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577938944:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.817717:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f9500 x1874433577939456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.817727:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577939456:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.817739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243661c00 x1874433577939968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.818230:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577939968:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.818259:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369e680 x1874433577940480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.818274:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577940480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599392.818287:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577938816:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.818297:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577939328:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.818307:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577939840:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.818318:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243663480 x1874433577940352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.818328:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577940352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599392.819077:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577938688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.819093:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577939200:0@lo:400:kworker.0 00010000:00080000:0.0:1787599392.819105:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243662d80 x1874433577940224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599392.819114:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577940224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599392.819137:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577939072:0@lo:400:kworker.0 00010000:00010000:2.0:1787599392.997329:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599393.317326:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599393.317351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577940608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599393.317418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.317598:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940608 00000100:00100000:0.0:1787599393.317608:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940608 00000100:00100000:0.0:1787599393.317658:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599393.317667:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577940608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599393.317695:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599393.317885:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577940608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 218us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599393.317907:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599393.328283:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599393.328321:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577940736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599393.328399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599393.328512:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940736 00000100:00100000:1.0:1787599393.328521:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940736 00000100:00100000:1.0:1787599393.328573:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599393.328583:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577940736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599393.328607:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599393.328652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577940736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599393.328658:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787599393.328695:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370013480 x1874433577940736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599393.328715:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577940736:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787599393.329640:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243662d80 x1874433577940608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599393.329658:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577940608:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1787599393.880589:0:12701:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599393.881116:0:12701:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599394.021955:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599394.343889:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577940864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599394.343965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599394.344210:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940864 00000100:00100000:0.0:1787599394.344217:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940864 00000100:00100000:0.0:1787599394.344266:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599394.344284:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577940864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599394.344321:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787599394.344373:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577940864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599394.344380:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599394.344420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577940864:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599395.050869:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599395.787171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599395.787402:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987264 00000100:00100000:0.0:1787599395.787411:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987264 00000100:00100000:0.0:1787599395.787462:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987520 00000100:00100000:0.0:1787599395.787464:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987520 00000100:00100000:0.0:1787599395.787477:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987136 00000100:00100000:0.0:1787599395.787480:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987136 00000100:00100000:0.0:1787599395.787502:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987392 00000100:00100000:0.0:1787599395.787504:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987392 00000100:00100000:0.0:1787599395.787519:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1787599395.787529:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558987264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599395.787624:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558987264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 95us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.787632:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1787599395.787651:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:0.0:1787599395.787658:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558987520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599395.787683:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558987520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.787688:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:0.0:1787599395.787698:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:0.0:1787599395.787704:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558987136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599395.787726:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558987136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.787731:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:0.0:1787599395.787740:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:0.0:1787599395.787757:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558987392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599395.787777:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558987392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.787782:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:0.0:1787599395.787826:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987648 00000100:00100000:0.0:1787599395.787830:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987648 00000100:00100000:0.0:1787599395.787856:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987776 00000100:00100000:0.0:1787599395.787865:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987776 00000100:00100000:0.0:1787599395.787887:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1787599395.787894:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2402:x1874433558987648:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1787599395.788377:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf3e0 00000100:00080000:0.0:1787599395.788392:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96b243359000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599395.788464:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787599395.788691:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+2:2402:x1874433558987648:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 795us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.788700:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1787599395.788717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599395.788725:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2402:x1874433558987776:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1787599395.788740:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf3e7 00000100:00080000:0.0:1787599395.788757:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96b24335a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599395.788779:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787599395.788875:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+2:2402:x1874433558987776:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 151us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599395.788882:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:0.0:1787599395.790244:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599395.790254:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599395.790258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787599395.790614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599395.791058:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599395.791312:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987008 00000100:00100000:2.0:1787599395.791325:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987008 00000100:00100000:2.0:1787599395.791391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 310 00000100:00100000:2.0:1787599395.791405:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558987008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599395.791494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558987008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599395.791504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 310 00010000:00010000:2.0:1787599395.791541:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599395.877178:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599395.877203:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577940992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599395.877276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599395.877417:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577940992 00000100:00100000:1.0:1787599395.877426:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577940992 00000100:00100000:1.0:1787599395.877482:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787599395.877494:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577940992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599395.877538:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599395.879236:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577940992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1737us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599395.879250:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787599395.885035:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577940992:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787599396.071830:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599396.323576:0:12799:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599396.325050:0:12799:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599397.094480:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599397.925669:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599397.925697:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599397.925809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.926112:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941120 00000100:00100000:0.0:1787599397.926121:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941120 00000100:00100000:0.0:1787599397.926179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787599397.926190:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577941120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599397.926222:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599397.926299:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577941120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599397.926307:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787599397.926332:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599397.926369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b241091f80 x1874433577941120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599397.926389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599397.929386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577941376:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599397.929503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577941888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599397.929545:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577942400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599397.929594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787599397.929599:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577941504:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599397.929645:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577942016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599397.929694:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577942528:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.929716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.929845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577941248:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.929883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.929924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577941760:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.929948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.929966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577942272:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.929987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.929999:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787599397.930005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577941632:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.930025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.930036:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577942144:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.930053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.930069:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577942656:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.930086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.930118:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941376 00000100:00100000:0.0:1787599397.930126:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941376 00000100:00100000:0.0:1787599397.930166:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941888 00000100:00100000:0.0:1787599397.930169:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941888 00000100:00100000:0.0:1787599397.930194:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942400 00000100:00100000:0.0:1787599397.930197:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942400 00000100:00100000:0.0:1787599397.930221:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942016 00000100:00100000:0.0:1787599397.930224:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942016 00000100:00100000:0.0:1787599397.930234:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942272 00000100:00100000:0.0:1787599397.930237:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942272 00000100:00100000:1.0:1787599397.930360:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941504 00000100:00100000:1.0:1787599397.930365:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941504 00000100:00100000:1.0:1787599397.930391:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941760 00000100:00100000:1.0:1787599397.930394:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941760 00000100:00100000:1.0:1787599397.930409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787599397.930426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577941504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930489:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577941504:12345-0@lo:400:kworker.0 Request processed in 65us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787599397.930516:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787599397.930523:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577941760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930554:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577941760:12345-0@lo:400:kworker.0 Request processed in 31us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930560:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787599397.930576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941632 00000100:00100000:1.0:1787599397.930579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941632 00000100:00100000:1.0:1787599397.930593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787599397.930599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577941376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930629:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577941376:12345-0@lo:400:kworker.0 Request processed in 30us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787599397.930647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787599397.930653:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577941888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930678:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577941888:12345-0@lo:400:kworker.0 Request processed in 25us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787599397.930694:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787599397.930700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577942400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930725:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577942400:12345-0@lo:400:kworker.0 Request processed in 25us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787599397.930764:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787599397.930769:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577942016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930822:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577942016:12345-0@lo:400:kworker.0 Request processed in 53us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930828:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787599397.930838:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787599397.930844:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577941632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577941632:12345-0@lo:400:kworker.0 Request processed in 31us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599397.930880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787599397.930924:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577941504:0@lo:400:kworker.0 00010000:00080000:1.0:1787599397.930939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a0a80 x1874433577942016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599397.930949:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577942016:0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930960:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577941376:0@lo:400:kworker.0 00000100:00100000:1.0:1787599397.930969:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577941888:0@lo:400:kworker.0 00010000:00080000:1.0:1787599397.930977:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9500 x1874433577942400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599397.930985:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577942400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.931261:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577941248 00000100:00100000:2.0:1787599397.931267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577941248 00000100:00100000:2.0:1787599397.931311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787599397.931318:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577941248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599397.931353:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577941248:12345-0@lo:400:kworker.0 Request processed in 36us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599397.931359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787599397.931515:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787599397.931524:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577942272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.931560:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577942272:12345-0@lo:400:kworker.0 Request processed in 38us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599397.931566:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787599397.931594:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942528 00000100:00100000:0.0:1787599397.931598:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942528 00000100:00100000:0.0:1787599397.931624:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942144 00000100:00100000:0.0:1787599397.931627:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942144 00000100:00100000:0.0:1787599397.931641:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942656 00000100:00100000:0.0:1787599397.931644:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942656 00000100:00100000:0.0:1787599397.931656:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599397.931662:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577942528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.931698:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577942528:12345-0@lo:400:kworker.0 Request processed in 36us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599397.931703:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599397.931713:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599397.931719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577942144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.931756:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577942144:12345-0@lo:400:kworker.0 Request processed in 38us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599397.931762:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599397.931772:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599397.931778:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577942656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.931828:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577942656:12345-0@lo:400:kworker.0 Request processed in 50us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599397.931845:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787599397.931877:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599397.931882:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599397.932278:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599397.932282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599397.932304:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577942784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599397.932341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599397.932387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577941632:0@lo:400:kworker.0 00010000:00080000:0.0:1787599397.932399:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3100 x1874433577942144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599397.932408:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577942144:0@lo:400:kworker.0 00010000:00080000:0.0:1787599397.932417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e9f80 x1874433577942656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599397.932426:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577942656:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.932435:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b241091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577941248:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.932446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577941760:0@lo:400:kworker.0 00000100:00100000:0.0:1787599397.932454:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577942272:0@lo:400:kworker.0 00000100:00100000:3.0:1787599397.932837:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942784 00000100:00100000:3.0:1787599397.932844:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942784 00000100:00100000:3.0:1787599397.932877:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599397.932885:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577942784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599397.932915:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599397.932958:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577942784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599397.932964:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1787599397.933232:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369c700 x1874433577942784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599397.933260:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577942784:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787599397.933290:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8000 x1874433577942528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599397.933315:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577942528:0@lo:400:kworker.0 00010000:00010000:0.0:1787599398.125490:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599398.439365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577942912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599398.439442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.439577:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577942912 00000100:00100000:3.0:1787599398.439586:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577942912 00000100:00100000:3.0:1787599398.439645:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787599398.439654:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577942912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599398.439680:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599398.439745:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577942912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599398.439753:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1787599398.440052:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369dc00 x1874433577942912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599398.440071:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577942912:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1787599398.442199:0:12896:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599398.442505:0:12896:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787599398.443259:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577943040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599398.443327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.443431:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943040 00000100:00100000:3.0:1787599398.443439:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943040 00000100:00100000:3.0:1787599398.443483:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787599398.443492:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577943040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599398.443514:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599398.443567:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577943040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599398.443575:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1787599398.444371:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369d180 x1874433577943040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599398.444391:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577943040:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787599399.141056:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599399.469034:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599399.469068:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577943168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599399.469146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599399.469250:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943168 00000100:00100000:3.0:1787599399.469265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943168 00000100:00100000:3.0:1787599399.469324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787599399.469334:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577943168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599399.469372:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599399.469430:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577943168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599399.469439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787599399.469474:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577943168:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599400.165470:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599400.906258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599400.906301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599400.906347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599400.906364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988032 00000100:00100000:1.0:1787599400.906374:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988032 00000100:00100000:2.0:1787599400.906376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599400.906398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599400.906419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988288 00000100:00100000:2.0:1787599400.906423:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988288 00000100:00100000:1.0:1787599400.906429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988160 00000100:00100000:1.0:1787599400.906432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988160 00000100:00100000:2.0:1787599400.906441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988416 00000100:00100000:2.0:1787599400.906443:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988416 00000100:00100000:1.0:1787599400.906447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:2.0:1787599400.906456:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:1.0:1787599400.906456:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558988032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599400.906461:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558988288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599400.906525:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558988032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599400.906532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1787599400.906534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558987904 00000100:00100000:3.0:1787599400.906538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558987904 00000100:00100000:1.0:1787599400.906549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1787599400.906555:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558988160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599400.906566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:3.0:1787599400.906572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558987904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599400.906619:0:10099:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787599400.906628:0:10099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787599400.906642:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787599400.906650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1787599400.906657:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558988416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599400.906700:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558988288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 238us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599400.906718:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:1.0:1787599400.910896:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558988160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 4328us (4506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599400.910911:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00080000:1.0:1787599400.910956:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599400.910962:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599400.911028:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558987904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 4453us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599400.911037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:0.0:1787599400.917157:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558988416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 10485us (10742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599400.917187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:2.0:1787599400.997611:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577943296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599400.997686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599400.998007:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943296 00000100:00100000:0.0:1787599400.998015:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943296 00000100:00100000:0.0:1787599400.998071:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787599400.998081:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577943296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599400.998115:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599400.998169:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577943296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599400.998176:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787599400.998358:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577943296:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599401.189070:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599401.511230:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000020:00000080:3.0:1787599401.511240:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b24335b000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000020:00000080:2.0:1787599401.511323:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24335b000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe for lustre-OST0000 00000020:00000080:2.0:1787599401.511369:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b243359000 for lustre-OST0000 00000001:00100000:1.0:1787599401.511460:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000020:00000080:1.0:1787599401.511465:0:9515:0:(genops.c:885:class_export_put()) final put ffff96b24335d800/e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000020:00000080:2.0:1787599401.511501:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24335d800/e17efe0f-8a41-4104-9ca3-3518d13d3cfe for lustre-OST0001 00000020:00000080:2.0:1787599401.511524:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b24335a800 for lustre-OST0001 00000001:02000400:2.0:1787599402.028169:0:13041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787599402.214456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599403.048188:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577943424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599403.048554:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577943680:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.048612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.048673:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599403.048679:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577943808:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.048720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599403.048889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599403.052927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943808 00000100:00100000:2.0:1787599403.052948:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943808 00000100:00100000:3.0:1787599403.053002:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943680 00000100:00100000:3.0:1787599403.053008:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943680 00000100:00100000:1.0:1787599403.053044:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577943936:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.053071:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787599403.053071:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787599403.053089:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577943808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.053090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.053276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577944320:0@lo:400:kworker.0 00000100:00100000:2.0:1787599403.059144:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577943808:12345-0@lo:400:kworker.0 Request processed in 6051us (10412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599403.059161:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787599403.061561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577943680:12345-0@lo:400:kworker.0 Request processed in 8464us (12934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.061601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787599403.061693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577943552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599403.061753:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.061788:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577944064:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.061816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.062963:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577944576:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.063049:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577945088:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063073:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.063103:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787599403.063111:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577944448:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.063156:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577944960:0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599403.063216:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943424 00000100:00100000:3.0:1787599403.063224:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943424 00000100:00100000:3.0:1787599403.063271:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943552 00000100:00100000:3.0:1787599403.063274:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943552 00000100:00100000:3.0:1787599403.063295:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599403.063304:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577943424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599403.063334:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599403.063376:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577943424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (14486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.063383:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599403.063400:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599403.063421:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577943552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599403.063436:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599403.063468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577943552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.063473:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599403.063492:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944576 00000100:00100000:3.0:1787599403.063497:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944576 00000100:00100000:3.0:1787599403.063519:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945088 00000100:00100000:3.0:1787599403.063522:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945088 00000100:00100000:3.0:1787599403.063534:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944960 00000100:00100000:3.0:1787599403.063537:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944960 00000100:00100000:3.0:1787599403.063551:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787599403.063557:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577944576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063588:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577944576:12345-0@lo:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.063595:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787599403.063606:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599403.063612:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577945088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063640:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577945088:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.063646:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599403.063657:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787599403.063663:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577944960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599403.063703:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577944960:12345-0@lo:400:kworker.0 Request processed in 39us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.063709:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787599403.063731:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599403.063742:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599403.063774:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412af800 x1874433577944960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599403.063788:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577944960:0@lo:400:kworker.0 00010000:00080000:3.0:1787599403.063821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d1c00 x1874433577943552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599403.063836:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577943552:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787599403.063844:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412ad180 x1874433577944576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599403.063866:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577944576:0@lo:400:kworker.0 00010000:00080000:3.0:1787599403.063876:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412aca80 x1874433577945088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599403.063884:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577945088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.066623:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577944192:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.066714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599403.066770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577944704:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.066815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599403.066853:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577943808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.066864:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577943680:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.066903:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944192 00000100:00100000:0.0:1787599403.066909:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944192 00000100:00100000:0.0:1787599403.066972:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787599403.066982:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577944192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.067034:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577944192:12345-0@lo:400:kworker.0 Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.067040:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787599403.067060:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944064 00000100:00100000:0.0:1787599403.067064:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944064 00000100:00100000:0.0:1787599403.067079:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944448 00000100:00100000:0.0:1787599403.067081:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944448 00000100:00100000:0.0:1787599403.067100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944704 00000100:00100000:0.0:1787599403.067103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944704 00000100:00100000:0.0:1787599403.067116:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787599403.067122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577944064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.067157:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577944064:12345-0@lo:400:kworker.0 Request processed in 35us (5340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.067164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787599403.067175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787599403.067181:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577944448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.067208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577944448:12345-0@lo:400:kworker.0 Request processed in 28us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.067223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787599403.067235:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787599403.067241:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577944704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.067269:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577944704:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.067275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787599403.067292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599403.067296:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787599403.075221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412adc00 x1874433577944448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599403.075240:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577944448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075256:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577944064:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075298:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577944192:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075311:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577944704:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599403.075396:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944320 00000100:00100000:0.0:1787599403.075402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944320 00000100:00100000:0.0:1787599403.075453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787599403.075462:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075521:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577944320:12345-0@lo:400:kworker.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.075529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1787599403.075547:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599403.075566:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577944320:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577944832:0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599403.075639:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577944832 00000100:00100000:0.0:1787599403.075643:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577944832 00000100:00100000:0.0:1787599403.075667:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787599403.075673:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577944832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.075721:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577944832:12345-0@lo:400:kworker.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.075728:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1787599403.075740:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787599403.075757:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412af480 x1874433577944832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599403.075767:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577944832:0@lo:400:kworker.0 00000100:00100000:1.0:1787599403.076471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787599403.076517:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369f480 x1874433577943424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599403.076536:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577943424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599403.076638:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577943936 00000100:00100000:0.0:1787599403.076644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577943936 00000100:00100000:0.0:1787599403.076698:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787599403.076707:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577943936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599403.076906:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577943936:12345-0@lo:400:kworker.0 Request processed in 200us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.076914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787599403.076992:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577943936:0@lo:400:kworker.0 00010000:00010000:2.0:1787599403.241965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599403.560675:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577945216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599403.560761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599403.570892:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577945344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599403.573605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599403.573729:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945216 00000100:00100000:0.0:1787599403.573740:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945216 00000100:00100000:2.0:1787599403.573868:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945344 00000100:00100000:2.0:1787599403.573873:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945344 00000100:00100000:2.0:1787599403.573900:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787599403.573910:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577945216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599403.573944:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599403.574020:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577945216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (13258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599403.574038:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787599403.574055:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787599403.574061:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577945344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599403.574071:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599403.574101:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577945344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599403.574106:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787599403.575205:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369d880 x1874433577945344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599403.575227:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577945344:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787599403.575900:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d1180 x1874433577945216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599403.575917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577945216:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787599404.262560:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599404.584960:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599404.584982:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577945472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599404.585053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599404.585115:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945472 00000100:00100000:3.0:1787599404.585123:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945472 00000100:00100000:3.0:1787599404.585163:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787599404.585170:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577945472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599404.585203:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599404.585243:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577945472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599404.585250:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787599404.585299:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577945472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599405.289299:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599405.742714:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd6f96890 20000000:00000080:0.0:1787599405.742733:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b24306fc00 uarg=0000000000000000 20000000:01000000:0.0:1787599405.742777:0:13189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787599405.742782:0:13189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787599405.742786:0:13189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787599405.743390:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787599405.743527:0:13189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787599405.750174:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599405.750362:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750389:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750400:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750408:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750414:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750448:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750456:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750464:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750525:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750544:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 12 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.750561:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945600:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599405.750889:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.750900:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 23 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.750910:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945728:0@lo:104: 00000100:00100000:2.0:1787599405.750953:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599405.750993:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751002:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 23 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.751018:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945856:0@lo:104: 00000100:00100000:2.0:1787599405.751039:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599405.751064:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751072:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 23 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.751081:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945984:0@lo:104: 00000100:00100000:2.0:1787599405.751099:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599405.751131:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945728 00000100:00100000:2.0:1787599405.751138:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945728 00000100:00100000:2.0:1787599405.751290:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945856 00000100:00100000:2.0:1787599405.751294:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945856 00000100:00100000:2.0:1787599405.751307:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577945984 00000100:00100000:2.0:1787599405.751309:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577945984 00000100:00100000:2.0:1787599405.751320:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599405.751328:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:13189:x1874433577945728:12345-0@lo:104: 00010000:00010000:2.0:1787599405.751341:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751396:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599405.751403:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:13189:x1874433577945728:12345-0@lo:104: Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.751410:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599405.751428:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599405.751434:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:13189:x1874433577945856:12345-0@lo:104: 00010000:00010000:2.0:1787599405.751451:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751483:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599405.751489:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:13189:x1874433577945856:12345-0@lo:104: Request processed in 55us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.751495:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599405.751506:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599405.751512:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13189:x1874433577945984:12345-0@lo:104: 00010000:00010000:2.0:1787599405.751518:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751545:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787599405.751550:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13189:x1874433577945984:12345-0@lo:104: Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.751555:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1787599405.751571:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599405.751577:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751584:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599405.751588:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.751597:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599405.751605:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599405.751617:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599405.751767:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599405.751773:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.751779:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031a00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599405.751782:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.751788:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599405.751820:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599405.752147:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599405.752174:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752188:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599405.752203:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752208:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340031a00/0x5d2988b0929cf3a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752222:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599405.752224:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752227:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599405.752229:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752234:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599405.752238:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599405.752240:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599405.752247:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752250:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599405.752264:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752268:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030600/0x5d2988b0929cf393 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf39a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752276:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599405.752277:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599405.752278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599405.752290:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577946112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599405.752318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599405.752358:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577946240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599405.752380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599405.752419:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946112 00000100:00100000:1.0:1787599405.752425:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946112 00010000:00010000:1.0:1787599405.752448:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 24 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.752471:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946240 00000100:00100000:1.0:1787599405.752474:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946240 00010000:00010000:1.0:1787599405.752484:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 25 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.752492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787599405.752496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+25:3648:x1874433577946112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.752504:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.752507:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 25 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752514:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 25 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752531:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599405.752559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+25:3648:x1874433577946112:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.752564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787599405.752578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599405.752583:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577946240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.752591:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.752595:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 24 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752603:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 24 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.752612:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599405.753054:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753060:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599405.753076:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753080:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf3af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753088:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.753089:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.753090:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.753095:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.753121:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753128:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 24 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.753135:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577946496:0@lo:104: 00000100:00100000:2.0:1787599405.753155:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599405.753253:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577946240:12345-0@lo:103:ldlm_bl.0 Request processed in 669us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.753260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599405.753298:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577946240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599405.753312:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599405.753317:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577946368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599405.753337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599405.753365:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577946112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599405.753379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946368 00000100:00100000:1.0:1787599405.753382:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946368 00010000:00010000:1.0:1787599405.753394:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 24 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.753423:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599405.753430:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577946368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.753440:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.753444:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 24 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.753452:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 24 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.753463:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599405.753488:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577946368:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.753494:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599405.753517:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577946368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599405.753590:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946496 00000100:00100000:2.0:1787599405.753593:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946496 00000100:00100000:2.0:1787599405.753619:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599405.753695:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13189:x1874433577946496:12345-0@lo:104: 00010000:00010000:2.0:1787599405.753704:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753814:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599405.753820:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13189:x1874433577946496:12345-0@lo:104: Request processed in 128us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.753883:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787599405.753913:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.753922:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 12 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.753931:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577946624:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599405.753970:0:13189:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438b9540 going to sleep for 11 seconds 00010000:00010000:2.0:1787599405.753982:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324800/0x5d2988b0929cf3b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf3af expref: 23 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.753991:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945728:0@lo:104: 00010000:00010000:2.0:1787599405.754000:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6e00/0x5d2988b0929cf3a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf3a1 expref: 22 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.754007:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945856:0@lo:104: 00010000:00010000:2.0:1787599405.754015:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030c00/0x5d2988b0929cf39a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf393 expref: 21 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.754023:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945984:0@lo:104: 00000100:00100000:2.0:1787599405.754029:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577946496:0@lo:104: 00010000:00010000:3.0:1787599405.761031:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599405.761046:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761058:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599405.761062:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761072:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599405.761079:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599405.761085:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599405.761142:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761149:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599405.761183:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761191:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030400/0x5d2988b0929cf385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf38c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761214:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599405.761216:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599405.761218:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599405.761411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599405.761473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599405.761511:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988672 00000100:00100000:3.0:1787599405.761518:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988672 00010000:00010000:3.0:1787599405.761545:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 13 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.761567:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988544 00000100:00100000:3.0:1787599405.761569:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988544 00010000:00010000:3.0:1787599405.761579:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 14 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.761590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1787599405.761598:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+14:2404:x1874433558988672:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599405.761609:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599405.761614:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 14 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761912:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 14 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.761932:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599405.761983:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+14:2404:x1874433558988672:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 385us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.761990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1787599405.762008:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1787599405.762013:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433558988544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599405.762019:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599405.762023:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 13 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.762042:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 13 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.762050:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599405.762064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433558988544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 52us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.762069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1787599405.762767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599405.762786:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577946752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599405.762941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599405.762978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946752 00000100:00100000:3.0:1787599405.762981:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946752 00010000:00010000:3.0:1787599405.762997:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.763013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599405.763017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3648:x1874433577946752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599405.763024:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599405.763027:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763033:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763043:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7600/0x5d2988b0929cf38c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf385 expref: 21 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763056:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763075:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763090:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763097:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763103:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763110:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763117:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599405.763121:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763129:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763137:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.763146:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599405.763186:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3648:x1874433577946752:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.763193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599405.763247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577946752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599405.763537:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6200/0x5d2988b0929cf3cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba4e expref: 12 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.763559:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577945600:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599405.763573:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381325000/0x5d2988b0929cf37e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba0f expref: 11 pid: 6514 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.763581:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1874433577946624:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599405.763608:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.763699:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.763708:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.763715:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929cf3ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599406.027435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599406.027480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599406.027517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599406.027555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599406.027642:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988800 00000100:00100000:0.0:1787599406.027653:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988800 00000100:00100000:0.0:1787599406.027729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989056 00000100:00100000:0.0:1787599406.027733:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989056 00000100:00100000:0.0:1787599406.027747:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558988928 00000100:00100000:0.0:1787599406.027749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558988928 00000100:00100000:0.0:1787599406.027758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989184 00000100:00100000:0.0:1787599406.027760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989184 00000100:00100000:0.0:1787599406.027775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:0.0:1787599406.027785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558988800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599406.027901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433558988800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 117us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.027909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:0.0:1787599406.027924:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1787599406.027930:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558989056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599406.027948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558989056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.027954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1787599406.027962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:0.0:1787599406.027967:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558988928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599406.027984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558988928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.028005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:0.0:1787599406.028015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1787599406.028021:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558989184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599406.028040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558989184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.028046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00080000:1.0:1787599406.028557:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599406.028564:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599406.117511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577946880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599406.117595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599406.117755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577946880 00000100:00100000:1.0:1787599406.117765:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577946880 00000100:00100000:1.0:1787599406.117874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787599406.117886:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577946880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599406.117925:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599406.123181:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577946880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5273us (5562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599406.123218:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787599406.125234:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577946880:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599406.312100:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787599406.949001:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599406.949009:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 7 10000000:01000000:3.0:1787599406.949014:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599406.949069:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949083:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949095:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599406.949125:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599406.949205:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599406.949269:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3706b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599406.949291:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947008 00000100:00100000:3.0:1787599406.949297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947008 00000100:00100000:3.0:1787599406.949345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787599406.949354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577947008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599406.949440:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599406.949458:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf3f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949484:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949495:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949515:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c600, rc 0) 00000100:00100000:3.0:1787599406.949552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599406.949558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787599406.949609:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599406.949624:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.949632:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599406.949923:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599406.949949:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599406.950026:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.961049:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947136 00000100:00100000:0.0:1787599406.961075:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947136 00000100:00100000:0.0:1787599406.961163:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787599406.961177:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.961369:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (11418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.961377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787599406.961437:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.961493:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.961555:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599406.961587:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3534990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.961601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947264 00000100:00100000:0.0:1787599406.961605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947264 00000100:00100000:0.0:1787599406.961630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787599406.961636:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.962063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 425us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.962070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787599406.962117:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599406.964162:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787599406.964335:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787599406.964361:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599406.964373:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.964385:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599406.964395:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599406.964409:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3778e6800 from 7 10000000:01000000:2.0:1787599406.964412:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599406.964454:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.964462:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.964472:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599406.964495:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.964565:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599406.964602:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.964898:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947392 00000100:00100000:0.0:1787599406.964906:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947392 00000100:00100000:0.0:1787599406.964950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787599406.964959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577947392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599406.964973:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599406.964987:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf403 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.965009:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.965018:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.965028:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325000, rc 0) 00000100:00100000:0.0:1787599406.965063:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.965069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787599406.965239:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599406.965253:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.965262:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599406.965317:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.965342:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599406.965365:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.965757:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947520 00000100:00100000:0.0:1787599406.965763:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947520 00000100:00100000:0.0:1787599406.965908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787599406.965918:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.966057:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.966065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787599406.966105:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.966163:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.966202:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599406.966217:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.966228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947648 00000100:00100000:0.0:1787599406.966232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947648 00000100:00100000:0.0:1787599406.966253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787599406.966259:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.966331:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.966337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787599406.966377:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599406.968243:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787599406.968643:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787599406.968739:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599406.968750:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.968763:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599406.968948:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599406.968951:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3812cf000 from 7 10000000:01000000:2.0:1787599406.968954:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599406.968994:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.969002:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.969012:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599406.969037:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.969096:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599406.969125:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.969186:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947776 00000100:00100000:0.0:1787599406.969194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947776 00000100:00100000:0.0:1787599406.969272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787599406.969283:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577947776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599406.969295:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599406.969310:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf411 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.969337:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.969348:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599406.969356:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324800, rc 0) 00000100:00100000:0.0:1787599406.969419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577947776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.969426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787599406.969495:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599406.969512:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599406.969520:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599406.969577:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599406.969606:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599406.969757:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787599406.969909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577947904 00000100:00100000:2.0:1787599406.969914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577947904 00000100:00100000:2.0:1787599406.969936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787599406.969941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577947904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.970049:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577947904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599406.970055:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787599406.970147:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577947904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599406.970178:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599406.970210:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599406.970233:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787599406.970274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948032 00000100:00100000:2.0:1787599406.970278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948032 00000100:00100000:2.0:1787599406.970305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787599406.970310:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577948032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.970379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577948032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599406.970390:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1787599406.970455:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787599406.974627:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787599406.978380:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787599406.978409:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599406.978422:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.978435:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599406.978447:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599406.978450:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3707b1000 from 7 10000000:01000000:2.0:1787599406.978453:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599406.978500:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.978508:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.978518:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599406.978542:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599406.978611:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599406.978671:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787599406.980783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948160 00000100:00100000:1.0:1787599406.980868:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948160 00000100:00100000:1.0:1787599406.980932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787599406.980942:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577948160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599406.980961:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599406.980980:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf41f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599406.981008:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599406.981019:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599406.981028:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030800, rc 0) 00000100:00100000:1.0:1787599406.981106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577948160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599406.981112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787599406.981168:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599406.981186:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599406.981195:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599406.981291:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599406.981326:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599406.981353:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.981962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948288 00000100:00100000:0.0:1787599406.981970:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948288 00000100:00100000:0.0:1787599406.982012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787599406.982020:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577948288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.982141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577948288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.982149:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787599406.982746:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599406.982782:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599406.982914:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599406.982943:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599406.987373:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948416 00000100:00100000:0.0:1787599406.987385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948416 00000100:00100000:0.0:1787599406.987448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787599406.987459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577948416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599406.987622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577948416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599406.987630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787599406.987780:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577948416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787599406.992055:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787599406.992282:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787599406.992306:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599406.992317:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599406.992329:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599407.303208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599407.307848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989312 00000100:00100000:0.0:1787599407.307869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989312 00000100:00100000:1.0:1787599407.308262:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:1.0:1787599407.308274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:6177:x1874433558989312:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599407.308293:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599407.308312:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba7f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.308342:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.308354:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.308363:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030600, rc 0) 00000100:00100000:1.0:1787599407.308425:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989312:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 154us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599407.308432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:0.0:1787599407.312862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599407.312967:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989440 00000100:00100000:2.0:1787599407.312977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989440 00000100:00100000:2.0:1787599407.313025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:2.0:1787599407.313036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989440:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599407.313177:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989440:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 142us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.313185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:3.0:1787599407.319127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599407.319223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989568 00000100:00100000:0.0:1787599407.319236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989568 00000100:00100000:0.0:1787599407.319298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:0.0:1787599407.319308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989568:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599407.319452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989568:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.319460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:3.0:1787599407.326201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599407.326360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989696 00000100:00100000:0.0:1787599407.326370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989696 00000100:00100000:0.0:1787599407.326428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:0.0:1787599407.326438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558989696:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599407.326454:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599407.326471:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba86 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.326498:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.326508:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.326517:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325200, rc 0) 00000100:00100000:0.0:1787599407.326575:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558989696:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.326582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:3.0:1787599407.328838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599407.328924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989824 00000100:00100000:2.0:1787599407.328934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989824 00000100:00100000:2.0:1787599407.328977:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:2.0:1787599407.328987:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558989824:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599407.329126:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558989824:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 140us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.329133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:3.0:1787599407.332783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599407.333088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558989952 00000100:00100000:2.0:1787599407.333100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558989952 00000100:00100000:2.0:1787599407.333162:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:2.0:1787599407.333174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558989952:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599407.333331:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558989952:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 159us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.333340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 331 00010000:00010000:3.0:1787599407.333541:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599408.182709:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577948672:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.182816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.182878:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577949184:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.182900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.182921:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577949696:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.182942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.182973:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787599408.182979:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577948544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183035:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577949056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183072:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183111:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577950080:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183155:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577948800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183194:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577949312:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183232:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577949824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183270:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787599408.183275:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577948928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183327:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577949440:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183363:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577949952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.183410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948672 00000100:00100000:1.0:1787599408.183418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948672 00000100:00100000:1.0:1787599408.183453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949184 00000100:00100000:1.0:1787599408.183456:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949184 00000100:00100000:1.0:1787599408.183474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949696 00000100:00100000:1.0:1787599408.183476:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949696 00000100:00100000:1.0:1787599408.183488:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949312 00000100:00100000:1.0:1787599408.183490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949312 00000100:00100000:1.0:1787599408.183500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949824 00000100:00100000:1.0:1787599408.183501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949824 00000100:00100000:1.0:1787599408.183510:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948928 00000100:00100000:1.0:1787599408.183512:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948928 00000100:00100000:1.0:1787599408.183526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599408.183535:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577948672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183588:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577948672:12345-0@lo:400:kworker.0 Request processed in 54us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599408.183613:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787599408.183619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577949184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183657:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577949184:12345-0@lo:400:kworker.0 Request processed in 38us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787599408.183674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787599408.183680:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577949696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577949696:12345-0@lo:400:kworker.0 Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787599408.183730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787599408.183736:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577949312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183765:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577949312:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787599408.183780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787599408.183786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577949824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577949824:12345-0@lo:400:kworker.0 Request processed in 47us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787599408.183849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787599408.183855:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577948928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183881:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577948928:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.183886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787599408.183911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948544 00000100:00100000:1.0:1787599408.183915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948544 00000100:00100000:1.0:1787599408.183943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787599408.183949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577948544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.183995:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577948544:12345-0@lo:400:kworker.0 Request processed in 46us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787599408.184040:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949056 00000100:00100000:1.0:1787599408.184044:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949056 00000100:00100000:1.0:1787599408.184066:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577948800 00000100:00100000:1.0:1787599408.184068:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577948800 00000100:00100000:1.0:1787599408.184080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787599408.184085:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577949056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184115:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577949056:12345-0@lo:400:kworker.0 Request processed in 29us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184121:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787599408.184132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599408.184138:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577948800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184164:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577948800:12345-0@lo:400:kworker.0 Request processed in 27us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184170:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599408.184185:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949568 00000100:00100000:1.0:1787599408.184188:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949568 00000100:00100000:1.0:1787599408.184204:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950080 00000100:00100000:1.0:1787599408.184207:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950080 00000100:00100000:1.0:1787599408.184217:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949440 00000100:00100000:1.0:1787599408.184219:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949440 00000100:00100000:1.0:1787599408.184230:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577949952 00000100:00100000:1.0:1787599408.184232:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577949952 00000100:00100000:1.0:1787599408.184243:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599408.184248:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184277:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577949568:12345-0@lo:400:kworker.0 Request processed in 29us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184282:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599408.184292:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599408.184298:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577950080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184334:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577950080:12345-0@lo:400:kworker.0 Request processed in 36us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184340:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599408.184351:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787599408.184356:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577949440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184380:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577949440:12345-0@lo:400:kworker.0 Request processed in 24us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184385:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787599408.184395:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599408.184399:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577949952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184421:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577949952:12345-0@lo:400:kworker.0 Request processed in 22us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.184427:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787599408.184464:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599408.184468:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599408.184471:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599408.184473:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599408.184501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577948544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184516:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577949056:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184531:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84e300 x1874433577949568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184541:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577949568:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184552:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1f80 x1874433577950080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184573:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577950080:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577948672:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184601:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577949184:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184611:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577949696:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184665:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577948928:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184676:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b343046d80 x1874433577949440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184685:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577949440:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84f480 x1874433577949952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184701:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577949952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184709:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577948800:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184719:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3480 x1874433577949312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184726:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577949312:0@lo:400:kworker.0 00010000:00080000:1.0:1787599408.184737:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84ed80 x1874433577949824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.184744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577949824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599408.184883:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577950208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599408.184923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.184963:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950208 00000100:00100000:1.0:1787599408.184967:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950208 00000100:00100000:1.0:1787599408.184996:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787599408.185003:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577950208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599408.185030:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599408.185066:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577950208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.185072:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787599408.185098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435aea00 x1874433577950208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.185110:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577950208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599408.193334:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599408.193360:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577950336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599408.193446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599408.193630:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950336 00000100:00100000:3.0:1787599408.193653:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950336 00000100:00100000:3.0:1787599408.193714:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787599408.193937:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577950336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599408.193962:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599408.194019:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577950336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599408.194027:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1787599408.194086:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369ed80 x1874433577950336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599408.194106:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577950336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787599408.367598:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599408.681855:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599408.681882:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577950464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599408.681959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599408.682033:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950464 00000100:00100000:1.0:1787599408.682041:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950464 00000100:00100000:1.0:1787599408.682094:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787599408.682106:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577950464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599408.682139:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599408.682184:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577950464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.682192:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1787599408.682232:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435aea00 x1874433577950464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599408.682250:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577950464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599408.685877:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599408.685898:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577950592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599408.685978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599408.686112:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950592 00000100:00100000:0.0:1787599408.686120:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950592 00000100:00100000:0.0:1787599408.686165:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787599408.686176:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577950592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599408.686197:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599408.686243:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577950592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.686250:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787599408.686286:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412adc00 x1874433577950592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599408.686305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577950592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599409.389349:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599409.486434:0:13387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787599409.705380:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599409.705414:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577950720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599409.705503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599409.705603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950720 00000100:00100000:3.0:1787599409.705612:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950720 00000100:00100000:3.0:1787599409.705675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787599409.705686:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577950720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599409.705740:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599409.705823:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577950720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.705831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787599409.705897:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577950720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599410.405024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599411.153979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599411.154026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599411.154056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599411.154075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599411.154096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599411.154124:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990208 00000100:00100000:0.0:1787599411.154151:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990208 00000100:00100000:0.0:1787599411.154208:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990464 00000100:00100000:0.0:1787599411.154211:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990464 00000100:00100000:0.0:1787599411.154228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990336 00000100:00100000:0.0:1787599411.154230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990336 00000100:00100000:0.0:1787599411.154244:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990592 00000100:00100000:0.0:1787599411.154246:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990592 00000100:00100000:0.0:1787599411.154261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:0.0:1787599411.154271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558990208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599411.154434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1787599411.154445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558990464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599411.154499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558990464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599411.154508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1787599411.154528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:2.0:1787599411.154534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558990336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599411.154571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558990336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 37us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599411.154577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:2.0:1787599411.154600:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:2.0:1787599411.154608:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558990592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599411.154641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558990592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599411.154647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:0.0:1787599411.155303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558990208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1030us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599411.155318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:0.0:1787599411.155356:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990080 00000100:00100000:0.0:1787599411.155361:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990080 00000100:00100000:0.0:1787599411.155391:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:0.0:1787599411.155398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558990080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599411.155441:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558990080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599411.155448:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00080000:0.0:1787599411.155480:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599411.155484:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599411.246166:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577950848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599411.246235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599411.246328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950848 00000100:00100000:3.0:1787599411.246336:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950848 00000100:00100000:3.0:1787599411.246389:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787599411.246400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577950848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599411.246443:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787599411.250343:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577950848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3933us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599411.250358:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787599411.250531:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577950848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599411.428968:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599412.453302:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599413.303494:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577951360:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303654:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577951872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303706:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577952384:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303767:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787599413.303775:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577950976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599413.303823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303846:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577951488:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303883:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577952000:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303918:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577952512:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.303957:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577951104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.303983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577951616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952128:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304083:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952640:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304115:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599413.304120:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577951232:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304149:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577951744:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577952256:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.304216:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951360 00000100:00100000:1.0:1787599413.304223:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951360 00000100:00100000:1.0:1787599413.304271:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951616 00000100:00100000:1.0:1787599413.304274:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951616 00000100:00100000:1.0:1787599413.304288:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599413.304297:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577951360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304350:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577951360:12345-0@lo:400:kworker.0 Request processed in 54us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304357:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599413.304372:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787599413.304378:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577951616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304402:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577951616:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304407:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787599413.304429:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951872 00000100:00100000:1.0:1787599413.304433:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951872 00000100:00100000:1.0:1787599413.304458:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952384 00000100:00100000:1.0:1787599413.304460:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952384 00000100:00100000:1.0:1787599413.304469:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951488 00000100:00100000:1.0:1787599413.304471:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951488 00000100:00100000:1.0:1787599413.304480:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951232 00000100:00100000:1.0:1787599413.304482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951232 00000100:00100000:1.0:1787599413.304491:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951744 00000100:00100000:1.0:1787599413.304493:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951744 00000100:00100000:1.0:1787599413.304501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952256 00000100:00100000:1.0:1787599413.304503:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952256 00000100:00100000:1.0:1787599413.304513:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787599413.304519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577951872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304545:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577951872:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304550:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787599413.304560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787599413.304566:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577952384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577952384:12345-0@lo:400:kworker.0 Request processed in 21us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304591:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787599413.304617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787599413.304622:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577951488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304645:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577951488:12345-0@lo:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787599413.304658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787599413.304663:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577951232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577951232:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304696:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787599413.304707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787599413.304712:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577951744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304732:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577951744:12345-0@lo:400:kworker.0 Request processed in 20us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304737:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787599413.304747:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787599413.304752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577952256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304775:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577952256:12345-0@lo:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787599413.304817:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952000 00000100:00100000:1.0:1787599413.304821:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952000 00000100:00100000:1.0:1787599413.304838:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952512 00000100:00100000:1.0:1787599413.304841:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952512 00000100:00100000:1.0:1787599413.304851:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952128 00000100:00100000:1.0:1787599413.304853:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952128 00000100:00100000:1.0:1787599413.304862:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952640 00000100:00100000:1.0:1787599413.304864:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952640 00000100:00100000:1.0:1787599413.304876:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787599413.304881:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577952000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304924:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577952000:12345-0@lo:400:kworker.0 Request processed in 42us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304930:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787599413.304941:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599413.304954:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577952512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.304980:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577952512:12345-0@lo:400:kworker.0 Request processed in 28us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.304986:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599413.304997:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787599413.305002:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305026:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952128:12345-0@lo:400:kworker.0 Request processed in 24us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.305031:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787599413.305040:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787599413.305046:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305067:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952640:12345-0@lo:400:kworker.0 Request processed in 22us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.305073:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787599413.305096:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577951104 00000100:00100000:1.0:1787599413.305099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577951104 00000100:00100000:1.0:1787599413.305124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787599413.305131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577951104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305157:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577951104:12345-0@lo:400:kworker.0 Request processed in 27us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.305163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787599413.305224:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577951488:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305237:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3480 x1874433577952000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305247:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577952000:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305265:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3100 x1874433577952512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305274:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577952512:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305284:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577951360:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305293:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84e300 x1874433577951872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305301:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577951872:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305311:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a0a80 x1874433577952384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305318:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577952384:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577951232:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305368:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577951744:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305376:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577952256:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577951104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305393:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577951616:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305402:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a1c00 x1874433577952128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952128:0@lo:400:kworker.0 00010000:00080000:1.0:1787599413.305419:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3434a3b80 x1874433577952640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305438:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952640:0@lo:400:kworker.0 00000100:00100000:1.0:1787599413.305651:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599413.305660:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599413.305688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599413.305716:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577950976 00000100:00100000:1.0:1787599413.305721:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577950976 00000100:00100000:1.0:1787599413.305742:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952768 00000100:00100000:1.0:1787599413.305745:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952768 00000100:00100000:1.0:1787599413.305757:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599413.305763:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577950976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599413.305787:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599413.305844:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577950976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.305850:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599413.305863:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599413.305869:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599413.305879:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599413.305904:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577952768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599413.305910:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787599413.305935:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435adc00 x1874433577950976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.305948:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577950976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787599413.306156:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599413.306161:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599413.306164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599413.306166:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787599413.306732:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435ae680 x1874433577952768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599413.307059:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577952768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787599413.477092:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599413.797196:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599413.797219:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577952896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599413.797286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599413.797403:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577952896 00000100:00100000:0.0:1787599413.797410:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577952896 00000100:00100000:0.0:1787599413.797472:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787599413.797480:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577952896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599413.797507:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599413.797551:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577952896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599413.797558:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787599413.797787:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412adf80 x1874433577952896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599413.797833:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577952896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599413.800251:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599413.800275:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577953024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599413.800342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599413.801674:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953024 00000100:00100000:0.0:1787599413.801686:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953024 00000100:00100000:0.0:1787599413.801744:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787599413.801754:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577953024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599413.801778:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599413.801890:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577953024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599413.801898:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1787599413.802218:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369d180 x1874433577953024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599413.802238:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577953024:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1787599414.423095:0:13536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:23:33 (1787599413) === 00010000:00010000:1.0:1787599414.503535:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599414.617147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.620136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.620183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990720 00000100:00100000:0.0:1787599414.620194:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990720 00000100:00100000:0.0:1787599414.620257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1787599414.620268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558990720:12345-192.168.202.1@tcp:41:mkdir.0 00000004:00000024:0.0:1787599414.620309:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787599414.620396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433558990720:12345-192.168.202.1@tcp:41:mkdir.0 Request processed in 129us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.620404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:0.0:1787599414.620426:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599414.620766:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558990848 00000100:00100000:2.0:1787599414.620772:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558990848 00000100:00100000:2.0:1787599414.620819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1787599414.620827:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:10498:x1874433558990848:12345-192.168.202.1@tcp:700:mkdir.0 00000100:00100000:2.0:1787599414.620874:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:10498:x1874433558990848:12345-192.168.202.1@tcp:700:mkdir.0 Request processed in 48us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599414.620881:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1787599414.633377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.633456:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991104 00000100:00100000:0.0:1787599414.633466:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991104 00000100:00100000:0.0:1787599414.633524:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599414.633535:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:10498:x1874433558991104:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:0.0:1787599414.633602:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599414.633956:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf2dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9fa expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.633975:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403100) 00010000:00010000:0.0:1787599414.633985:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599414.634064:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.634092:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.634288:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.634304:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.634312:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.634318:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635043:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635055:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635063:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599414.635079:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c737479 reply state 00000000f5915413 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635090:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635097:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:0.0:1787599414.635117:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599414.635121:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787599414.635127:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787599414.635136:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635142:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635149:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635154:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599414.635158:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635166:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635348:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599414.635352:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599414.635356:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635363:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf43b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599414.635390:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c737479 reply state 00000000f5915413 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635400:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.635417:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b355403700) 00010000:00010000:0.0:1787599414.635419:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599414.635422:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787599414.635513:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:10498:x1874433558991104:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 1976us (2146us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787599414.635521:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599414.643921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599414.644075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991232 00000100:00100000:1.0:1787599414.644086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991232 00000100:00100000:1.0:1787599414.644142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1787599414.644153:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:10499:x1874433558991232:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:1.0:1787599414.644271:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599414.644294:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba8d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644346:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644356:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644364:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599414.644400:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787599414.644402:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599414.644428:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba8d expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644471:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba8d expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.644477:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b370675300) 00010000:00010000:1.0:1787599414.644479:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599414.644482:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031400, rc 0) 00000100:00100000:1.0:1787599414.644531:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:10499:x1874433558991232:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 379us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.644538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1787599414.647007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.647061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991488 00000100:00100000:0.0:1787599414.647069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991488 00000100:00100000:0.0:1787599414.647114:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1787599414.647124:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:10499:x1874433558991488:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:0.0:1787599414.647241:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599414.647266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf457 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba8d expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.647279:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b370675300) 00010000:00010000:0.0:1787599414.647287:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599414.647307:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.647315:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.647321:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599414.647472:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b0dabde reply state 00000000edcbbca8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.647490:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.647494:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599414.647496:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787599414.647497:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787599414.647503:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787599414.647571:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:10499:x1874433558991488:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 449us (570us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787599414.647578:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599414.664374:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.664481:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991616 00000100:00100000:0.0:1787599414.664492:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991616 00000100:00100000:0.0:1787599414.664593:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599414.664606:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:10500:x1874433558991616:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1787599414.664628:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599414.664646:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba94 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664703:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664716:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664726:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599414.664778:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599414.664781:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599414.664877:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664902:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba94 expref: 11 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664930:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba94 expref: 10 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.664939:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599414.664942:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599414.664945:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324c00, rc 0) 00000100:00100000:0.0:1787599414.664991:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+10:10500:x1874433558991616:12345-192.168.202.1@tcp:101:chown.0 Request processed in 388us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.664997:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1787599414.667425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.668044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991744 00000100:00100000:2.0:1787599414.668054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991744 00000100:00100000:3.0:1787599414.668167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1787599414.668176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+10:10500:x1874433558991744:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1787599414.668193:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599414.668212:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adba9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668265:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668288:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668299:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668309:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668317:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668323:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668388:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668395:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599414.668437:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787599414.668439:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599414.668455:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668466:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668481:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668488:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668494:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599414.668497:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668504:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668516:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:3.0:1787599414.668519:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599414.668523:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668530:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf47a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668541:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668546:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668552:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668557:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599414.668563:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668570:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668576:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b355403700) 00010000:00010000:3.0:1787599414.668578:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599414.668594:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668600:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668623:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba9b expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668634:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba9b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.668641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:3.0:1787599414.668644:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599414.668646:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d600, rc 0) 00000100:00100000:3.0:1787599414.668693:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10500:x1874433558991744:12345-192.168.202.1@tcp:101:chown.0 Request processed in 519us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599414.668700:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1787599414.671985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.672077:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558991872 00000100:00100000:0.0:1787599414.672089:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558991872 00000100:00100000:0.0:1787599414.672460:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1787599414.672471:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10500:x1874433558991872:12345-192.168.202.1@tcp:900:chown.0 00000100:00100000:0.0:1787599414.672579:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10500:x1874433558991872:12345-192.168.202.1@tcp:900:chown.0 Request processed in 110us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.672596:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599414.675132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.675279:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558992128 00000100:00100000:0.0:1787599414.675294:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558992128 00000100:00100000:0.0:1787599414.675352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599414.675362:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10500:x1874433558992128:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:0.0:1787599414.675415:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599414.675452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba9b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.675470:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:0.0:1787599414.675474:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599414.675495:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.675506:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.675515:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599414.677559:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1787599414.677649:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f56db7d reply state 00000000340e97e2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.677669:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.677678:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:0.0:1787599414.677680:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787599414.677684:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787599414.677696:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1787599414.677825:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787599414.677843:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:10500:x1874433558992128:12345-192.168.202.1@tcp:36:chown.0 Request processed in 2480us (2728us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787599414.677851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00010000:00010000:3.0:1787599414.677999:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678008:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678025:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678030:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599414.678034:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678042:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678053:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:3.0:1787599414.678056:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787599414.678060:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.678067:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf48f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687806:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687825:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687834:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687841:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599414.687847:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687854:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687871:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b355403700) 00010000:00010000:1.0:1787599414.687892:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599414.687897:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687904:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf442 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687939:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687946:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687951:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687956:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599414.687959:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687965:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687973:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:1.0:1787599414.687975:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599414.687978:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687982:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf449 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.687996:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688011:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688016:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688020:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599414.688023:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688028:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688036:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:1.0:1787599414.688038:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787599414.688040:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.688045:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf45e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599414.690378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.690513:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558992256 00000100:00100000:2.0:1787599414.690524:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558992256 00000100:00100000:2.0:1787599414.690620:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1787599414.690629:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+6:10501:x1874433558992256:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:2.0:1787599414.690652:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599414.690672:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbaa2 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599414.695104:0:13004:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4381us 00010000:00010000:3.0:1787599414.706663:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706688:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706699:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706713:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706728:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706736:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706909:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706919:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.706926:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599414.706965:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787599414.706969:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599414.707008:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707019:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707024:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707031:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707036:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599414.707041:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707054:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707066:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:3.0:1787599414.707069:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599414.707073:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707078:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf49d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707090:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707094:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707099:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707104:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599414.707106:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707111:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707117:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b242d00200) 00010000:00010000:3.0:1787599414.707119:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599414.707277:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707295:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf4a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707336:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa2 expref: 8 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707351:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa2 expref: 7 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.707359:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:3.0:1787599414.707361:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787599414.707363:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:3.0:1787599414.707440:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+7:10501:x1874433558992256:12345-192.168.202.1@tcp:101:touch.500 Request processed in 16810us (17071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599414.707449:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1787599414.714118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599414.714268:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558992512 00000100:00100000:1.0:1787599414.714279:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558992512 00000100:00100000:1.0:1787599414.714340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1787599414.714352:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:10501:x1874433558992512:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:1.0:1787599414.714372:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599414.714394:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf4b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbaa9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714504:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714530:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714541:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714607:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714615:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.714622:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599414.715298:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787599414.715413:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf4c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715423:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715431:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715461:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715469:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715475:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715488:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599414.715492:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715497:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:1.0:1787599414.715508:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599414.715512:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715516:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599414.715527:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066bcc28e reply state 000000007234bab8 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff96b370675300) 00010000:00010000:1.0:1787599414.715539:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599414.715541:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599414.715562:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf4b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa9 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715572:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa9 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.715610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b370675b00) 00010000:00010000:1.0:1787599414.715613:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599414.715615:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030400, rc 0) 00000100:00100000:1.0:1787599414.715722:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+10:10501:x1874433558992512:12345-192.168.202.1@tcp:101:touch.500 Request processed in 1370us (1612us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787599414.715729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1787599414.719443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.719530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558992768 00000100:00100000:2.0:1787599414.719539:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558992768 00000100:00100000:2.0:1787599414.719604:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1787599414.719614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+10:10501:x1874433558992768:12345-192.168.202.1@tcp:36:touch.500 00010000:00010000:2.0:1787599414.719666:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599414.719689:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf4c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa9 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.719704:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b370675b00) 00010000:00010000:2.0:1787599414.719731:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599414.719786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.719854:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.719865:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599414.719952:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbd475a5 reply state 0000000082a1d26f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.719961:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.719965:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599414.719967:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599414.719968:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599414.720035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10501:x1874433558992768:12345-192.168.202.1@tcp:36:touch.500 Request processed in 423us (610us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787599414.720040:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1787599414.721915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.722069:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558992896 00000100:00100000:2.0:1787599414.722077:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558992896 00000100:00100000:2.0:1787599414.722118:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1787599414.722258:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+11:10501:x1874433558992896:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:2.0:1787599414.722278:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599414.722294:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7e00/0x5d2988b0929cf4dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbab0 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.722334:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7e00/0x5d2988b0929cf4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab0 expref: 12 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.722354:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7e00/0x5d2988b0929cf4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab0 expref: 12 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.722376:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599414.722378:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599414.722380:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7e00, rc 0) 00000100:00100000:2.0:1787599414.722476:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+12:10501:x1874433558992896:12345-192.168.202.1@tcp:101:touch.500 Request processed in 222us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599414.722483:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1787599414.724694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.724910:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993024 00000100:00100000:2.0:1787599414.724920:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993024 00000100:00100000:2.0:1787599414.724999:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1787599414.725007:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433558993024:12345-192.168.202.1@tcp:8:touch.500 00010000:00080000:2.0:1787599414.725037:0:8629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:2.0:1787599414.725068:0:8629:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf4e3 00002000:00100000:2.0:1787599414.725080:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4ef2ef44-63df-45fd-9e68-c54398cec083/ffff96b3819f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599414.725108:0:8629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599414.725291:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599414.725316:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b2419ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599414.725401:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433558993024:12345-192.168.202.1@tcp:8:touch.500 Request processed in 392us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599414.725418:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1787599414.729255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599414.729709:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993152 00000100:00100000:1.0:1787599414.729720:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993152 00000100:00100000:1.0:1787599414.729823:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1787599414.729833:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433558993152:12345-192.168.202.1@tcp:2:touch.500 00000100:00080000:0.0:1787599414.731314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787599414.732435:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787599414.732445:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000100:00100000:1.0:1787599414.732641:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:0:x1874433558993152:12345-192.168.202.1@tcp:2:touch.500 Request processed in 2805us (3391us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787599414.732651:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1787599414.734545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.734622:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993408 00000100:00100000:0.0:1787599414.734632:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993408 00000100:00100000:0.0:1787599414.734689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1787599414.734699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+12:10501:x1874433558993408:12345-192.168.202.1@tcp:35:touch.500 00000100:00100000:0.0:1787599414.735540:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:10501:x1874433558993408:12345-192.168.202.1@tcp:35:touch.500 Request processed in 839us (998us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787599414.735558:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1787599414.747087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599414.747473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993536 00000100:00100000:1.0:1787599414.747484:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993536 00000100:00100000:1.0:1787599414.747619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1787599414.747631:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:10502:x1874433558993536:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1787599414.747655:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599414.747675:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbab7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.747741:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.747765:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.748337:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599414.748469:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599414.748473:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599414.748593:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.748628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf4ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab7 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.748650:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab7 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.748659:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:0.0:1787599414.748661:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599414.748665:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031a00, rc 0) 00000100:00100000:0.0:1787599414.748775:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+14:10502:x1874433558993536:12345-192.168.202.1@tcp:101:rm.0 Request processed in 1146us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.748783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1787599414.752607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.752667:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993792 00000100:00100000:0.0:1787599414.752676:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993792 00000100:00100000:0.0:1787599414.752739:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1787599414.752760:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+14:10502:x1874433558993792:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1787599414.752833:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599414.752856:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf4f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbabe expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599414.752952:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787599414.753073:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf4f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbabe expref: 16 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.753089:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599414.753092:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599414.753109:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf4f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbabe expref: 16 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.753840:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324e00, rc 0) 00000100:00100000:0.0:1787599414.754338:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+15:10502:x1874433558993792:12345-192.168.202.1@tcp:101:rm.0 Request processed in 1578us (1741us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1787599414.754345:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1787599414.757443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.757642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558993920 00000100:00100000:0.0:1787599414.757653:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558993920 00000100:00100000:0.0:1787599414.757718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1787599414.757730:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+15:10502:x1874433558993920:12345-192.168.202.1@tcp:37:rm.0 00000100:00100000:0.0:1787599414.764634:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+15:10502:x1874433558993920:12345-192.168.202.1@tcp:37:rm.0 Request processed in 6893us (7189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.764648:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1787599414.768040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.768403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558994176 00000100:00100000:2.0:1787599414.768414:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558994176 00000100:00100000:2.0:1787599414.768524:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1787599414.768535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+15:10502:x1874433558994176:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:2.0:1787599414.768771:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+16:10502:x1874433558994176:12345-192.168.202.1@tcp:35:rm.0 Request processed in 238us (740us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787599414.768779:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599414.771478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599414.771644:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558994432 00000100:00100000:1.0:1787599414.771654:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558994432 00000100:00100000:1.0:1787599414.771710:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1787599414.771720:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+16:10502:x1874433558994432:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1787599414.771755:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599414.771776:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbac5 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.771902:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf50d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.771916:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf50d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.771926:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf50d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599414.771938:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787599414.772032:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbac5 expref: 19 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.772050:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf50d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbac5 expref: 18 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599414.772059:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:1.0:1787599414.772074:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599414.772077:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030400, rc 0) 00000100:00100000:1.0:1787599414.772151:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558994432:12345-192.168.202.1@tcp:101:rm.0 Request processed in 432us (682us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787599414.772158:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1787599414.775470:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.775597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558994560 00000100:00100000:0.0:1787599414.775607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558994560 00000100:00100000:0.0:1787599414.775662:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1787599414.775687:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558994560:12345-192.168.202.1@tcp:41:rm.0 00000004:00000024:0.0:1787599414.775882:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787599414.775935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558994560:12345-192.168.202.1@tcp:41:rm.0 Request processed in 252us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.775940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1787599414.778023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.778073:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558994688 00000100:00100000:0.0:1787599414.778080:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558994688 00000100:00100000:0.0:1787599414.778134:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1787599414.778145:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558994688:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1787599414.778162:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599414.778183:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf51b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbacc expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778245:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778256:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778263:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778270:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778274:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778278:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778369:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778375:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778379:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599414.778411:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787599414.778415:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599414.778433:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778446:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778452:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778457:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778461:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778465:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599414.778467:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778472:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778486:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:0.0:1787599414.778488:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599414.778491:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778495:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf522 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778526:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778530:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778533:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778536:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599414.778537:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778541:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778545:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff96b370675300) 00010000:00010000:0.0:1787599414.778546:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599414.778547:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778550:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf529 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778577:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf51b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbacc expref: 20 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778601:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbacc expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.778608:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599414.778611:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599414.778613:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325400, rc 0) 00000100:00100000:0.0:1787599414.779074:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:10502:x1874433558994688:12345-192.168.202.1@tcp:101:rm.0 Request processed in 929us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599414.779088:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1787599414.781546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599414.781995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558994944 00000100:00100000:2.0:1787599414.782006:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558994944 00000100:00100000:2.0:1787599414.782053:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1787599414.782064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+19:10502:x1874433558994944:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1787599414.782115:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787599414.782140:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf530 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbacc expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782229:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7e00/0x5d2988b0929cf4dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab0 expref: 18 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782238:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599414.782246:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf4f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbab7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:2.0:1787599414.782254:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599414.782272:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782282:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782302:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782320:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782325:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782329:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782452:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782458:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782462:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599414.782691:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787599414.782699:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361401905828ns, next at 362401904119ns, rc = 0 00010000:00010000:2.0:1787599414.782857:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782866:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782874:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782892:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782899:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782905:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782921:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599414.782939:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782945:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782951:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599414.782951:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782957:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599414.782961:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782962:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782968:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599414.782968:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782972:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782978:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782978:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599414.782981:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787599414.782984:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782986:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:3.0:1787599414.782989:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599414.782991:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.782998:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf54c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.782998:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf545 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599414.783009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599414.783010:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599414.783011:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599414.783014:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783019:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783024:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783029:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599414.783032:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783036:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783041:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:2.0:1787599414.783043:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599414.783044:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783048:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7600/0x5d2988b0929cf537 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599414.783054:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d219cd0 reply state 0000000083e4fc61 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783061:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599414.783070:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff96b370675300) 00010000:00010000:2.0:1787599414.783072:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599414.783074:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599414.783140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558994944:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1076us (1602us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787599414.783148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1787599414.786505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.786668:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995200 00000100:00100000:0.0:1787599414.786678:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995200 00000100:00100000:0.0:1787599414.786737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1787599414.786974:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558995200:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:0.0:1787599414.787317:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+19:10502:x1874433558995200:12345-192.168.202.1@tcp:35:rm.0 Request processed in 570us (820us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787599414.787325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1787599414.791517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599414.791623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995456 00000100:00100000:0.0:1787599414.791633:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995456 00000100:00100000:0.0:1787599414.791727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1787599414.791738:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:10502:x1874433558995456:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:0.0:1787599414.791963:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787599414.791990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030400/0x5d2988b0929cf50d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbac5 expref: 19 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792036:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaa2 expref: 18 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b242d00300) 00010000:00010000:0.0:1787599414.792062:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324c00/0x5d2988b0929cf46c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba94 expref: 17 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792084:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599414.792090:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599414.792114:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792135:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792144:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792158:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792165:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792172:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792245:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792264:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792270:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599414.792478:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787599414.792493:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792500:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792507:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792513:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599414.792518:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792526:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792534:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96b355403800) 00010000:00010000:0.0:1787599414.792537:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787599414.792540:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792546:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf561 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792565:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792577:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792596:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792600:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599414.792603:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792609:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792617:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403100) 00010000:00010000:0.0:1787599414.792619:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599414.792622:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792627:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf553 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599414.792642:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000326177b6 reply state 00000000af8db258 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792653:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599414.792659:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b355403200) 00010000:00010000:0.0:1787599414.792661:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599414.792663:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599414.792921:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:10502:x1874433558995456:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1183us (1411us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787599414.792936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1787599414.821947:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599414.821972:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577953152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599414.822042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599414.822360:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953152 00000100:00100000:2.0:1787599414.822369:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953152 00000100:00100000:2.0:1787599414.822418:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787599414.822428:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577953152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599414.822456:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599414.822512:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577953152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599414.822519:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787599414.822612:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577953152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599415.526210:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599416.272284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599416.272339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599416.272459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599416.272501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599416.272535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995712 00000100:00100000:0.0:1787599416.272545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995712 00000100:00100000:0.0:1787599416.272625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996224 00000100:00100000:0.0:1787599416.272629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996224 00000100:00100000:0.0:1787599416.272654:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1787599416.272666:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+18:2406:x1874433558995712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599416.272747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+18:2406:x1874433558995712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599416.272755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1787599416.272772:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:0.0:1787599416.272779:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558996224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599416.272851:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558996224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599416.272857:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:0.0:1787599416.272876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995584 00000100:00100000:0.0:1787599416.272879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995584 00000100:00100000:0.0:1787599416.272903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:0.0:1787599416.272910:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558995584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599416.272933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433558995584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599416.272950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00080000:0.0:1787599416.272977:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599416.272981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599416.274374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599416.274410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599416.274435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995840 00000100:00100000:1.0:1787599416.274442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995840 00000100:00100000:1.0:1787599416.274488:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996096 00000100:00100000:1.0:1787599416.274491:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996096 00000100:00100000:1.0:1787599416.274512:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:1.0:1787599416.274521:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558995840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599416.274587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558995840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599416.274593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:1.0:1787599416.274610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1787599416.274617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558996096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599416.274641:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433558996096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599416.274646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00080000:1.0:1787599416.274664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599416.274667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599416.275286:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558995968 00000100:00100000:2.0:1787599416.275292:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558995968 00000100:00100000:1.0:1787599416.277149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1787599416.277163:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558995968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599416.277328:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558995968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 167us (4987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599416.277337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00080000:0.0:1787599416.279733:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599416.357485:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577953280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599416.357580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599416.357659:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953280 00000100:00100000:0.0:1787599416.357667:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953280 00000100:00100000:0.0:1787599416.357718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787599416.357728:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577953280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599416.357763:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599416.357834:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577953280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599416.357841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787599416.357887:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577953280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599416.552047:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599417.573229:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599418.406192:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577953408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599418.406267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.406447:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577953536:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.406485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.406531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953536 00000100:00100000:1.0:1787599418.406538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953536 00000100:00100000:1.0:1787599418.406603:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787599418.406613:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577953536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.406669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577953536:12345-0@lo:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.406677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787599418.406727:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577953536:0@lo:400:kworker.0 00000004:00080000:0.0:1787599418.408054:0:8628:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365027258923ns, next at 366027255324ns, rc = 0 00000100:00100000:0.0:1787599418.408078:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599418.408094:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577953664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599418.408149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.408317:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953408 00000100:00100000:1.0:1787599418.408325:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953408 00000100:00100000:1.0:1787599418.408383:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953664 00000100:00100000:1.0:1787599418.408387:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953664 00000100:00100000:1.0:1787599418.408418:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599418.408428:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577953408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599418.408453:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787599418.408516:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599418.408868:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787599418.408880:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577953664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599418.408892:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599418.408931:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577953664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599418.408955:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1787599418.409000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243757100 x1874433577953664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599418.409018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577953664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599418.413336:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577953792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.413417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599418.413461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577954304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.413484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599418.413503:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577954816:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.413526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599418.413546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599418.413564:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577954176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.413588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599418.413606:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577954688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.413625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599418.413838:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953792 00000100:00100000:2.0:1787599418.413857:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953792 00000100:00100000:2.0:1787599418.413910:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954304 00000100:00100000:2.0:1787599418.413913:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954304 00000100:00100000:2.0:1787599418.413944:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954688 00000100:00100000:2.0:1787599418.413947:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954688 00000100:00100000:2.0:1787599418.413964:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787599418.413973:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577953792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414035:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433577953792:12345-0@lo:400:kworker.0 Request processed in 62us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599418.414042:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787599418.414076:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787599418.414083:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577954304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414112:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433577954304:12345-0@lo:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599418.414117:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787599418.414128:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787599418.414135:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577954688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414162:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577954688:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599418.414167:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787599418.414187:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954816 00000100:00100000:2.0:1787599418.414191:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954816 00000100:00100000:2.0:1787599418.414218:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787599418.414225:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577954816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414254:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577954816:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599418.414261:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787599418.414283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599418.414287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599418.414290:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599418.414316:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2df80 x1874433577954688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599418.414331:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577954688:0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433577953792:0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.414352:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433577954304:0@lo:400:kworker.0 00010000:00080000:2.0:1787599418.414372:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369ed80 x1874433577954816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599418.414380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577954816:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.414722:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577953408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6292us (8450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.414742:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599418.414776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954176 00000100:00100000:1.0:1787599418.414781:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954176 00000100:00100000:1.0:1787599418.414838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599418.414855:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577954176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.414898:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577954176:12345-0@lo:400:kworker.0 Request processed in 53us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.414904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599418.414929:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577954048:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.414959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.414983:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577954560:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.415024:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787599418.415030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577953920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.415066:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577954432:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.415100:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577954944:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599418.415143:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954944 00000100:00100000:1.0:1787599418.415146:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954944 00000100:00100000:1.0:1787599418.415176:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787599418.415182:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577954944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577954944:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.415228:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787599418.415248:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954048 00000100:00100000:1.0:1787599418.415252:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954048 00000100:00100000:1.0:1787599418.415271:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954560 00000100:00100000:1.0:1787599418.415274:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954560 00000100:00100000:1.0:1787599418.415290:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577954432 00000100:00100000:1.0:1787599418.415293:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577954432 00000100:00100000:1.0:1787599418.415306:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787599418.415312:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577954048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415343:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577954048:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.415350:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787599418.415362:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787599418.415368:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577954560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415395:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577954560:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.415401:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787599418.415411:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787599418.415417:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577954432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415443:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577954432:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.415448:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1787599418.415464:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599418.415467:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599418.415470:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787599418.415489:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87f100 x1874433577954432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599418.415512:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577954432:0@lo:400:kworker.0 00010000:00080000:1.0:1787599418.415525:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d0a80 x1874433577954944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599418.415534:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577954944:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415544:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577954048:0@lo:400:kworker.0 00000100:00100000:1.0:1787599418.415567:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b343044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577954560:0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.415736:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577953920 00000100:00100000:0.0:1787599418.415741:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577953920 00000100:00100000:0.0:1787599418.415778:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787599418.415785:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577953920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599418.415853:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577953920:12345-0@lo:400:kworker.0 Request processed in 60us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599418.415859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787599418.415891:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577953920:0@lo:400:kworker.0 00000100:00100000:2.0:1787599418.416017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577954176:0@lo:400:kworker.0 00010000:00080000:3.0:1787599418.416546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84f480 x1874433577953408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599418.416674:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577953408:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787599418.597542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599418.917501:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599418.917599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599418.917677:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955072 00000100:00100000:0.0:1787599418.917685:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955072 00000100:00100000:0.0:1787599418.917733:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787599418.917743:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577955072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599418.917772:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599418.917846:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577955072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599418.917856:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1787599418.917902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243755500 x1874433577955072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599418.917921:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599418.923297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577955200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599418.923375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599418.926537:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955200 00000100:00100000:3.0:1787599418.926565:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955200 00000100:00100000:3.0:1787599418.926642:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787599418.926656:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577955200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599418.926686:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599418.926773:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577955200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599418.926781:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1787599418.926850:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243755500 x1874433577955200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599418.926873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577955200:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1787599418.970755:0:13684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787599419.632436:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599419.941675:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599419.947513:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577955328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599419.947608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.951424:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955328 00000100:00100000:1.0:1787599419.951441:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955328 00000100:00100000:3.0:1787599419.951723:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787599419.951736:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577955328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599419.951774:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599419.951886:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577955328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599419.951894:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787599419.952103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577955328:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787599420.217098:0:13732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcde019ec0 20000000:00000080:3.0:1787599420.217116:0:13732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b243401000 uarg=0000000000000000 20000000:01000000:3.0:1787599420.217162:0:13732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787599420.217169:0:13732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787599420.217174:0:13732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787599420.218978:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787599420.219253:0:13732:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787599420.227131:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787599420.227189:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787599420.227211:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787599420.227229:0:13732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599420.227249:0:13732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227267:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227275:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227286:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227292:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227302:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227309:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227332:0:13732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227678:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227694:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.227709:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955456:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599420.227831:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227841:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 12 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.227849:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955584:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599420.227883:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227892:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 23 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.227901:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955712:0@lo:104: 00000100:00100000:2.0:1787599420.227938:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599420.227970:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.227988:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 23 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.227998:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955840:0@lo:104: 00010000:00010000:2.0:1787599420.228026:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.228034:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.228041:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955968:0@lo:104: 00010000:00010000:2.0:1787599420.228057:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.228064:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.228071:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577956096:0@lo:104: 00000100:00100000:2.0:1787599420.228084:0:13732:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599420.228126:0:8450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787599420.228148:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599420.228185:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599420.228200:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599420.228210:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955712 00000100:00100000:0.0:1787599420.228217:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955712 00000100:00100000:0.0:1787599420.228255:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955840 00000100:00100000:0.0:1787599420.228258:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955840 00000100:00100000:0.0:1787599420.228269:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577955968 00000100:00100000:0.0:1787599420.228271:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577955968 00000100:00100000:0.0:1787599420.228278:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956096 00000100:00100000:0.0:1787599420.228280:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956096 00000100:00100000:0.0:1787599420.228292:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599420.228307:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243070050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:13732:x1874433577955712:12345-0@lo:104: 00010000:00010000:0.0:1787599420.228322:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.228375:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599420.228381:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243070050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+6:13732:x1874433577955712:12345-0@lo:104: Request processed in 76us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599420.228388:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599420.228427:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599420.228435:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:13732:x1874433577955840:12345-0@lo:104: 00010000:00010000:0.0:1787599420.228442:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.228475:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599420.228480:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+5:13732:x1874433577955840:12345-0@lo:104: Request processed in 46us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599420.228485:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599420.228498:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599420.228504:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:13732:x1874433577955968:12345-0@lo:104: 00010000:00010000:0.0:1787599420.228511:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.228559:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787599420.228564:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+4:13732:x1874433577955968:12345-0@lo:104: Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599420.228569:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599420.228581:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599420.228593:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13732:x1874433577956096:12345-0@lo:104: 00010000:00010000:0.0:1787599420.228602:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.228634:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787599420.228638:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+3:13732:x1874433577956096:12345-0@lo:104: Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599420.228644:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787599420.228873:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787599420.228884:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.228892:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599420.228896:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.228905:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599420.228912:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599420.228918:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599420.228949:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.228955:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599420.228975:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.228982:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929cf41f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf426 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.228994:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787599420.228998:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229003:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599420.229006:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.229515:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955712:0@lo:104: 00000100:00100000:2.0:1787599420.229527:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955840:0@lo:104: 00000100:00100000:2.0:1787599420.229545:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955968:0@lo:104: 00000100:00100000:2.0:1787599420.229556:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577956096:0@lo:104: 00010000:00010000:3.0:1787599420.229557:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599420.229568:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599420.229574:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599420.229602:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229610:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599420.229617:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229625:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929cf411 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf418 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229634:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599420.229637:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229643:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599420.229646:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229653:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599420.229659:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599420.229671:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599420.229683:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229689:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599420.229716:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229724:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929cf403 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.229764:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577956480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.229816:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599420.229820:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229826:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599420.229828:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599420.229835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599420.229842:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599420.229850:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599420.229856:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599420.229871:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229877:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599420.229908:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229914:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929cf3f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929cf3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.229928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599420.229930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599420.229932:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599420.229940:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599420.229950:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577956224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599420.229981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599420.229985:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599420.230005:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599420.230011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577956608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599420.230016:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577956352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599420.230038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599420.230302:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599420.230309:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599420.230353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599420.230387:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956480 00000100:00100000:3.0:1787599420.230393:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956480 00010000:00010000:3.0:1787599420.230421:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 24 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.230442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956224 00000100:00100000:3.0:1787599420.230445:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956224 00010000:00010000:3.0:1787599420.230458:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 25 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.230467:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956608 00000100:00100000:3.0:1787599420.230470:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956608 00010000:00010000:3.0:1787599420.230480:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 26 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.230489:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956352 00000100:00100000:3.0:1787599420.230499:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956352 00010000:00010000:3.0:1787599420.230511:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 27 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.230525:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599420.230545:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+27:3645:x1874433577956480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.230558:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.230563:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 27 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230573:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 27 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230587:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381325000/0x5d2988b0929cf40a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf403 expref: 27 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230600:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.230642:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+26:3645:x1874433577956480:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.230649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599420.230665:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599420.230671:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+25:3647:x1874433577956224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.230679:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.230684:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 25 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230692:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 25 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230702:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030800/0x5d2988b0929cf426 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf41f expref: 25 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230719:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.230860:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577956224:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.230868:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787599420.230875:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577956480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599420.230885:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599420.230894:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3645:x1874433577956608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.230902:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.230907:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230915:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230925:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf3fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf3f5 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.230933:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.230966:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3645:x1874433577956608:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.230972:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599420.230990:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599420.230998:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3647:x1874433577956352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599420.231010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577956608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.231020:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.231037:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 21 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.231046:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 21 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.231061:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324800/0x5d2988b0929cf418 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929cf411 expref: 21 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.231069:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.231092:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3647:x1874433577956352:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.231098:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599420.231403:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577956224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599420.231420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577956352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599420.232471:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955456:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599420.232485:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1874433577955584:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599420.232522:0:13732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599420.233290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599420.233367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000004:00080000:1.0:1787599420.233673:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787599420.233748:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1787599420.233759:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787599420.233776:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996480 00000100:00100000:3.0:1787599420.233784:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996480 00010000:00010000:3.0:1787599420.233840:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 13 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.233866:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996352 00000100:00100000:3.0:1787599420.233870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996352 00010000:00010000:3.0:1787599420.233880:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 14 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599420.233894:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1787599420.233902:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+14:2403:x1874433558996480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.233914:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.233919:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 14 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.233930:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 14 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.233945:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030600/0x5d2988b0929cf42d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba7f expref: 14 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.233981:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.234046:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558996480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 143us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.234054:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1787599420.234071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599420.234078:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:2403:x1874433558996352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599420.234086:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599420.234091:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234101:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234112:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381325200/0x5d2988b0929cf434 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba86 expref: 12 pid: 6515 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234123:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234131:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234146:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234153:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234170:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234177:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234183:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599420.234189:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234197:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234211:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.234221:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599420.234242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:2403:x1874433558996352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 164us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599420.234248:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:2.0:1787599420.234330:0:13732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.234338:0:13732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599420.234344:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243758a00/0x5d2988b0929cf568 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599420.236000:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599420.236018:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577956736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787599420.236078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599420.236127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956736 00000100:00100000:0.0:1787599420.236134:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956736 00000100:00100000:0.0:1787599420.236183:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599420.236193:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577956736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787599420.236219:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1787599420.236250:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c9a36, atime: 0x6a8c9a36, ctime: 0x6a8c9a36, blocks: 0x0 00010000:00010000:0.0:1787599420.236259:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236273:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1787599420.236278:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599420.236292:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236307:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236318:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236326:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236343:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787599420.236491:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577956736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (412us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787599420.236499:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787599420.236520:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787599420.236542:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599420.236549:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236557:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599420.236561:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236569:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236596:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236604:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c001e7bf/0x5d2988b0929cf56f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236621:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599420.236623:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599420.236624:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787599420.236652:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b243754a80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787599420.236659:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577956736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787599420.236916:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236925:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236931:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236936:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599420.236941:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236947:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236959:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff96b370675300) 00010000:00010000:0.0:1787599420.236968:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599420.236973:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236979:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf4c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.236998:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237004:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237010:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237016:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599420.237029:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237036:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237044:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599420.237046:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599420.237050:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237055:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929cf4d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237071:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237088:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237094:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237099:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599420.237103:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237110:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237119:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff96b370675300) 00010000:00010000:0.0:1787599420.237122:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599420.237125:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237130:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929cf53e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237147:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237153:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237159:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237164:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599420.237173:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237180:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237188:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96b355403200) 00010000:00010000:0.0:1787599420.237191:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599420.237194:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599420.237200:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf55a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599420.647768:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599421.124396:0:13781:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca7924e50 20000000:00000080:2.0:1787599421.124414:0:13781:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b2436cc000 uarg=0000000000000000 20000000:01000000:2.0:1787599421.124455:0:13781:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787599421.124463:0:13781:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787599421.124467:0:13781:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787599421.125338:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787599421.125570:0:13781:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787599421.125668:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787599421.125698:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787599421.125712:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787599421.125723:0:13781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787599421.125745:0:13781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.125761:0:13781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.125783:0:13781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.125976:0:13781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.125986:0:13781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.125994:0:13781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.126001:0:13781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599421.126006:0:13781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.126014:0:13781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.126027:0:13781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.126035:0:13781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.126042:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c600/0x5d2988b0929cf576 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599421.382560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599421.382823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996608 00000100:00100000:0.0:1787599421.382835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996608 00000100:00100000:0.0:1787599421.382895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:0.0:1787599421.382907:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:2404:x1874433558996608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599421.382988:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:2404:x1874433558996608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.382996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:1.0:1787599421.391372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599421.391475:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996736 00000100:00100000:2.0:1787599421.391484:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996736 00000100:00100000:2.0:1787599421.391685:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:2.0:1787599421.391834:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558996736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599421.391920:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558996736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 132us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.391928:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00080000:0.0:1787599421.392372:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599421.397776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599421.397846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599421.397878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599421.397899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599421.397927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997248 00000100:00100000:2.0:1787599421.397936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997248 00000100:00100000:3.0:1787599421.398209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996864 00000100:00100000:3.0:1787599421.398214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996864 00000100:00100000:3.0:1787599421.398271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997120 00000100:00100000:3.0:1787599421.398275:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997120 00000100:00100000:3.0:1787599421.398301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:3.0:1787599421.398311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558996864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599421.398389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433558996864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.398397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:3.0:1787599421.398414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:3.0:1787599421.398420:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558997120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599421.398445:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433558997120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.398451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00080000:3.0:1787599421.398608:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599421.398612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599421.399074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:2.0:1787599421.399084:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558997248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599421.399121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558997248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.399127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:1.0:1787599421.399304:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558996992 00000100:00100000:1.0:1787599421.399310:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558996992 00000100:00100000:1.0:1787599421.399362:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1787599421.399370:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558996992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599421.399402:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558996992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599421.399416:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00080000:0.0:1787599421.399475:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599421.477929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599421.477955:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577956864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599421.478031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787599421.478285:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599421.478291:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 7 10000000:01000000:1.0:1787599421.478295:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599421.478333:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599421.478344:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599421.478355:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599421.478370:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577956992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599421.478405:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599421.478437:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.478654:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956864 00000100:00100000:0.0:1787599421.478662:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956864 00000100:00100000:0.0:1787599421.478730:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787599421.478741:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577956864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599421.478773:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599421.478856:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577956864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.478877:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787599421.479627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577956864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599421.479718:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577956992 00000100:00100000:2.0:1787599421.479725:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577956992 00000100:00100000:2.0:1787599421.479768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787599421.479777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:6517:x1874433577956992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599421.479821:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599421.479837:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759a00/0x5d2988b0929cf584 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf57d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.479863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759a00/0x5d2988b0929cf584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf57d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.479875:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759a00/0x5d2988b0929cf584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf57d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.479899:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759a00, rc 0) 00000100:00100000:2.0:1787599421.479944:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577956992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.479950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787599421.480835:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577956992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599421.480855:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599421.480864:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599421.480934:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599421.480973:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599421.481003:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.481091:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957120 00000100:00100000:0.0:1787599421.481096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957120 00000100:00100000:0.0:1787599421.481135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787599421.481143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577957120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.481256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577957120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.481264:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787599421.481295:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.481321:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.481361:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.481376:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344d41000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.481387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957248 00000100:00100000:0.0:1787599421.481390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957248 00000100:00100000:0.0:1787599421.481408:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787599421.481414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577957248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.481491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577957248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.481498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787599421.481567:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.481781:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13794:1874433577957376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.481845:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.481863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957376 00000100:00100000:0.0:1787599421.481867:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957376 00000100:00100000:0.0:1787599421.481891:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787599421.481897:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:13794:x1874433577957376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.481971:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:13794:x1874433577957376:12345-0@lo:502:llog_process_th.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.481978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787599421.482015:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352014d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.482028:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13794:1874433577957376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599421.482049:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599421.482058:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.482061:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599421.482068:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f896800 00000020:00000080:0.0:1787599421.482070:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599421.482128:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599421.483824:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.483831:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599421.483839:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599421.483845:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.483846:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787599421.483851:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f896800 00000020:00000080:0.0:1787599421.483853:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599421.484331:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13794:1874433577957504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.484405:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.484442:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957504 00000100:00100000:0.0:1787599421.484448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957504 00000100:00100000:0.0:1787599421.484487:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787599421.484497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:13794:x1874433577957504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599421.487163:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.500969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:13794:x1874433577957504:12345-0@lo:502:llog_process_th.0 Request processed in 16464us (16555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.500993:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787599421.501241:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13794:1874433577957504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599421.501278:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599421.501286:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599421.501288:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787599421.501293:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787599421.501765:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787599421.502901:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599421.502916:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.502928:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599421.502938:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599421.502941:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3778e6800 from 7 10000000:01000000:0.0:1787599421.502943:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599421.502983:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.502991:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.503000:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599421.503022:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.505227:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.505284:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599421.505620:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957632 00000100:00100000:2.0:1787599421.505629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957632 00000100:00100000:2.0:1787599421.505701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787599421.505712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:6517:x1874433577957632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599421.505730:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599421.505750:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759600/0x5d2988b0929cf592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf58b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.505777:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759600/0x5d2988b0929cf592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf58b expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.505788:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759600/0x5d2988b0929cf592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf58b expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.505815:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759600, rc 0) 00000100:00100000:2.0:1787599421.505884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577957632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.505904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787599421.506626:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599421.506645:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.506655:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599421.506780:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.506851:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.506885:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599421.507199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957760 00000100:00100000:2.0:1787599421.507206:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957760 00000100:00100000:2.0:1787599421.507247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787599421.507256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577957760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599421.507366:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577957760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.507373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787599421.509140:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.509201:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.509270:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.509296:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599421.509355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577957888 00000100:00100000:3.0:1787599421.509362:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577957888 00000100:00100000:3.0:1787599421.509409:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787599421.509418:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577957888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599421.509538:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577957888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.509545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787599421.510629:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577957888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599421.516287:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13797:1874433577958016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599421.516375:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599421.516424:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352014480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599421.516485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958016 00000100:00100000:3.0:1787599421.516493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958016 00000100:00100000:3.0:1787599421.516569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787599421.516578:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:13797:x1874433577958016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599421.516714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:13797:x1874433577958016:12345-0@lo:502:llog_process_th.0 Request processed in 136us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.516722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787599421.516882:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13797:1874433577958016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599421.516911:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599421.516921:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.516923:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599421.516930:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3778e6800 00000020:00000080:0.0:1787599421.516933:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599421.516988:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599421.516992:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.516993:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599421.516994:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599421.516996:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.516997:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787599421.516999:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3778e6800 00000020:00000080:0.0:1787599421.517000:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599421.517023:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13797:1874433577958144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.517059:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.517079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958144 00000100:00100000:0.0:1787599421.517086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958144 00000100:00100000:0.0:1787599421.517103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787599421.517107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:13797:x1874433577958144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.517155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:13797:x1874433577958144:12345-0@lo:502:llog_process_th.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.517160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787599421.517184:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.517192:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13797:1874433577958144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599421.517204:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599421.517207:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.517208:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787599421.517210:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787599421.517257:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787599421.517275:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599421.517285:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517296:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599421.517306:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599421.517308:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3812cf000 from 7 10000000:01000000:0.0:1787599421.517310:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599421.517333:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517341:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517350:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599421.517370:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517397:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.517411:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.517423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958272 00000100:00100000:0.0:1787599421.517426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958272 00000100:00100000:0.0:1787599421.517443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787599421.517449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:6517:x1874433577958272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599421.517457:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599421.517470:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b381324800/0x5d2988b0929cf5a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf599 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517489:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b381324800/0x5d2988b0929cf5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf599 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517499:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b381324800/0x5d2988b0929cf5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf599 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517508:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324800, rc 0) 00000100:00100000:0.0:1787599421.517547:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.517554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787599421.517582:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599421.517594:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.517602:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599421.517649:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517667:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.517676:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.517696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958400 00000100:00100000:0.0:1787599421.517699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958400 00000100:00100000:0.0:1787599421.517711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787599421.517714:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.517786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787599421.517826:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517842:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517866:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.517875:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599421.517882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958528 00000100:00100000:0.0:1787599421.517884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958528 00000100:00100000:0.0:1787599421.517895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787599421.517899:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.517944:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 44us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599421.517949:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787599421.517972:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599421.520846:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13799:1874433577958656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599421.520908:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599421.520940:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958656 00000100:00100000:3.0:1787599421.520945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958656 00000100:00100000:3.0:1787599421.520976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787599421.520981:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:13799:x1874433577958656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599421.521122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:13799:x1874433577958656:12345-0@lo:502:llog_process_th.0 Request processed in 141us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.521128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787599421.521164:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1787599421.521179:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13799:1874433577958656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599421.521199:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599421.521205:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599421.521207:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599421.521214:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3812cf000 00000020:00000080:3.0:1787599421.521216:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599421.521250:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599421.521429:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599421.521431:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599421.521437:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599421.521440:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599421.521442:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787599421.521452:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3812cf000 00000020:00000080:3.0:1787599421.521455:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:1.0:1787599421.522358:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787599421.522997:0:13799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13799:1874433577958784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599421.523083:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.523115:0:13799:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599421.523674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958784 00000100:00100000:2.0:1787599421.523682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958784 00000100:00100000:2.0:1787599421.523731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787599421.523740:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:13799:x1874433577958784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599421.523894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:13799:x1874433577958784:12345-0@lo:502:llog_process_th.0 Request processed in 154us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.523902:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787599421.524663:0:13799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13799:1874433577958784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599421.524709:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599421.524717:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599421.524719:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787599421.524724:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787599421.526026:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787599421.526126:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599421.526138:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526151:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599421.526162:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599421.526164:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3707b1000 from 7 10000000:01000000:3.0:1787599421.526167:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599421.526200:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526208:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526218:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599421.526240:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599421.526302:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599421.526347:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1787599421.526364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577958912 00000100:00100000:3.0:1787599421.526370:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577958912 00000100:00100000:3.0:1787599421.526418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787599421.526427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:6517:x1874433577958912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599421.526439:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599421.526461:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200d000/0x5d2988b0929cf5ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929cf5a7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526484:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200d000/0x5d2988b0929cf5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929cf5a7 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526494:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200d000/0x5d2988b0929cf5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929cf5a7 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599421.526865:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d000, rc 0) 00000100:00100000:3.0:1787599421.526908:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577958912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 481us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599421.526915:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787599421.527030:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577958912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599421.527055:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599421.527065:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599421.527120:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577959040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.527146:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.527171:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599421.527266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959040 00000100:00100000:1.0:1787599421.527271:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959040 00000100:00100000:1.0:1787599421.527305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787599421.527314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577959040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599421.527429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577959040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599421.527436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787599421.527590:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577959040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.527616:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577959168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599421.527654:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599421.528726:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599421.535914:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959168 00000100:00100000:1.0:1787599421.535929:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959168 00000100:00100000:1.0:1787599421.535993:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787599421.536004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577959168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599421.536181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:6517:x1874433577959168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (8525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599421.536189:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787599421.539682:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:6517:1874433577959168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599421.540753:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13801:1874433577959296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599421.540846:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599421.540883:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599421.540940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959296 00000100:00100000:2.0:1787599421.540947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959296 00000100:00100000:2.0:1787599421.540993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787599421.541001:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:13801:x1874433577959296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599421.541113:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:13801:x1874433577959296:12345-0@lo:502:llog_process_th.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.541120:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787599421.541302:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13801:1874433577959296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599421.541327:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599421.541337:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599421.541339:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599421.541346:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3707b1000 00000020:00000080:1.0:1787599421.541349:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599421.541407:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599421.541416:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599421.541418:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599421.541421:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599421.541423:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599421.541425:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787599421.541428:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3707b1000 00000020:00000080:1.0:1787599421.541430:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599421.541462:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13801:1874433577959424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599421.541495:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599421.541534:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599421.541971:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959424 00000100:00100000:2.0:1787599421.541975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959424 00000100:00100000:2.0:1787599421.542003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787599421.542010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:13801:x1874433577959424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599421.542633:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:13801:x1874433577959424:12345-0@lo:502:llog_process_th.0 Request processed in 620us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599421.542642:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787599421.542827:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:13801:1874433577959424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599421.542850:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599421.542856:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599421.542857:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787599421.542861:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787599421.543123:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787599421.543144:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599421.543152:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599421.543163:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599421.550280:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599421.673261:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599422.030679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599422.030901:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997376 00000100:00100000:1.0:1787599422.030912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997376 00000100:00100000:1.0:1787599422.030977:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00100000:1.0:1787599422.030988:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:6177:x1874433558997376:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599422.031004:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599422.031022:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b340030400/0x5d2988b0929cf5b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbad3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599422.031054:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b340030400/0x5d2988b0929cf5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbad3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599422.031066:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b340030400/0x5d2988b0929cf5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbad3 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599422.031093:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030400, rc 0) 00000100:00100000:1.0:1787599422.031153:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558997376:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 166us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599422.031160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00100000:2.0:1787599422.038038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599422.038884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997504 00000100:00100000:1.0:1787599422.038897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997504 00000100:00100000:1.0:1787599422.038970:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 359 00000100:00100000:1.0:1787599422.038981:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558997504:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599422.039137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558997504:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 157us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599422.039146:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 359 00000100:00100000:0.0:1787599422.050206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599422.050561:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997632 00000100:00100000:2.0:1787599422.050573:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997632 00000100:00100000:2.0:1787599422.050630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:2.0:1787599422.050640:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558997632:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599422.050819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558997632:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 153us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599422.050835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:2.0:1787599422.054594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599422.054672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997760 00000100:00100000:3.0:1787599422.054689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997760 00000100:00100000:3.0:1787599422.054747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:3.0:1787599422.054756:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:10788:x1874433558997760:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599422.054939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:10788:x1874433558997760:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599422.054948:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:3.0:1787599422.059664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599422.059784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558997888 00000100:00100000:1.0:1787599422.059823:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558997888 00000100:00100000:1.0:1787599422.059893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:1.0:1787599422.059905:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:10788:x1874433558997888:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599422.060079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:10788:x1874433558997888:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 175us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599422.060087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:0.0:1787599422.086821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599422.089992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998016 00000100:00100000:2.0:1787599422.090010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998016 00000100:00100000:2.0:1787599422.090084:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:2.0:1787599422.090096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:6177:x1874433558998016:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599422.090130:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599422.090150:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243758e00/0x5d2988b0929cf5bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbada expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599422.090180:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243758e00/0x5d2988b0929cf5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbada expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599422.090191:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243758e00/0x5d2988b0929cf5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbada expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599422.090201:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758e00, rc 0) 00000100:00100000:2.0:1787599422.090279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558998016:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 185us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599422.090287:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:0.0:1787599422.106002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599422.106144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998144 00000100:00100000:3.0:1787599422.106156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998144 00000100:00100000:3.0:1787599422.106225:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:3.0:1787599422.106245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558998144:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599422.106414:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558998144:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 179us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599422.106450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:3.0:1787599422.109557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599422.109839:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998272 00000100:00100000:1.0:1787599422.109850:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998272 00000100:00100000:1.0:1787599422.109911:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:1.0:1787599422.109923:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558998272:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599422.110071:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:6177:x1874433558998272:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 149us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599422.110089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:0.0:1787599422.114868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599422.115035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998400 00000100:00100000:3.0:1787599422.115048:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998400 00000100:00100000:3.0:1787599422.115099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:3.0:1787599422.115109:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:10791:x1874433558998400:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599422.115330:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:10791:x1874433558998400:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599422.115338:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:0.0:1787599422.123929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599422.124415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998528 00000100:00100000:2.0:1787599422.124428:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998528 00000100:00100000:2.0:1787599422.124495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 367 00000100:00100000:2.0:1787599422.124506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:10791:x1874433558998528:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599422.124704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:10791:x1874433558998528:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 199us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599422.124712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 367 00000040:00080000:1.0:1787599422.565623:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787599422.568093:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599422.693091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599423.525130:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599423.525153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577959552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599423.525223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525341:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959552 00000100:00100000:0.0:1787599423.525349:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959552 00000100:00100000:0.0:1787599423.525412:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599423.525422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577959552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599423.525451:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599423.525491:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577959552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599423.525498:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599423.525533:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577960064:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525543:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577959936:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525602:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577960448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525658:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577960960:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.525699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525699:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787599423.525704:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577959808:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.525721:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577960576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.525741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.525759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577961088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.525819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525834:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577960320:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.525836:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599423.525840:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577959680:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525872:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577960832:0@lo:400:kworker.0 00000100:00100000:0.0:1787599423.525890:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599423.525922:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959936 00000100:00100000:0.0:1787599423.525927:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959936 00000100:00100000:0.0:1787599423.525953:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787599423.525968:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577959936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599423.526448:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960960 00000100:00100000:1.0:1787599423.526453:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960960 00000100:00100000:1.0:1787599423.526483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960576 00000100:00100000:1.0:1787599423.526487:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960576 00000100:00100000:1.0:1787599423.526499:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961088 00000100:00100000:1.0:1787599423.526501:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961088 00000100:00100000:1.0:1787599423.526528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787599423.526534:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577960960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787599423.526593:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599423.526597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599423.526611:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960448 00000100:00100000:3.0:1787599423.526615:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960448 00000100:00100000:3.0:1787599423.526645:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960064 00000100:00100000:3.0:1787599423.526648:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960064 00000100:00100000:3.0:1787599423.526658:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959808 00000100:00100000:3.0:1787599423.526661:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959808 00000100:00100000:3.0:1787599423.526671:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960320 00000100:00100000:3.0:1787599423.526673:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960320 00000100:00100000:3.0:1787599423.526685:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960832 00000100:00100000:3.0:1787599423.526688:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960832 00000100:00100000:3.0:1787599423.526702:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787599423.526708:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577960448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599423.530440:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577960960:12345-0@lo:400:kworker.0 Request processed in 3895us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599423.530455:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787599423.530491:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599423.530513:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577960576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.530648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.530695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577960192:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.530731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.530760:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577960704:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.530785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.531350:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577960576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.531366:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599423.531378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577961216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599423.531405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599423.531706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960704 00000100:00100000:2.0:1787599423.531714:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960704 00000100:00100000:2.0:1787599423.531753:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787599423.531762:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577960064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577960064:12345-0@lo:400:kworker.0 Request processed in 397us (6458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.532166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787599423.532183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787599423.532190:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577959808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532288:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577959808:12345-0@lo:400:kworker.0 Request processed in 32us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.532294:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787599423.532307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787599423.532326:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577960320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577960320:12345-0@lo:400:kworker.0 Request processed in 33us (6502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.532363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787599423.532376:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787599423.532382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577960832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532410:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577960832:12345-0@lo:400:kworker.0 Request processed in 28us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.532481:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787599423.532495:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787599423.532502:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577960704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532614:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577960704:12345-0@lo:400:kworker.0 Request processed in 113us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.532621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787599423.532658:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577960704:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.532671:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577960064:0@lo:400:kworker.0 00000100:00080000:2.0:1787599423.532717:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599423.532722:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599423.532752:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577959552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599423.532780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577960192 00000100:00100000:2.0:1787599423.532786:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577960192 00000100:00100000:2.0:1787599423.532849:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599423.533180:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577960192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.533329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577960192:12345-0@lo:400:kworker.0 Request processed in 152us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.533345:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787599423.533380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577960192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599423.533819:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577960576:12345-0@lo:400:kworker.0 Request processed in 70us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599423.533832:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599423.533854:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599423.533875:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577961088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.536372:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577959808:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.536394:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577960320:0@lo:400:kworker.0 00010000:00080000:2.0:1787599423.536409:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c3b80 x1874433577960832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599423.536421:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577960832:0@lo:400:kworker.0 00010000:00080000:2.0:1787599423.536434:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c1180 x1874433577960960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599423.536443:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577960960:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.536484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577959680 00000100:00100000:2.0:1787599423.536491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577959680 00000100:00100000:2.0:1787599423.536700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787599423.536712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577959680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.544868:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577959680:12345-0@lo:400:kworker.0 Request processed in 8138us (14200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599423.544885:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787599423.545047:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577959936:12345-0@lo:400:kworker.0 Request processed in 19076us (19461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599423.545066:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787599423.545118:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961216 00000100:00100000:0.0:1787599423.545127:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961216 00000100:00100000:0.0:1787599423.545172:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599423.545182:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577961216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599423.545207:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599423.545265:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577961216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (13859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599423.545271:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599423.545329:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577961216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599423.545343:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577959680:0@lo:400:kworker.0 00000100:00100000:2.0:1787599423.554038:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577959936:0@lo:400:kworker.0 00000100:00100000:1.0:1787599423.560065:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577961088:12345-0@lo:400:kworker.0 Request processed in 26185us (34225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599423.560081:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787599423.560736:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577960448:12345-0@lo:400:kworker.0 Request processed in 34025us (35093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599423.560763:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:2.0:1787599423.561092:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c1880 x1874433577960448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599423.561109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577960448:0@lo:400:kworker.0 00010000:00080000:0.0:1787599423.561654:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c0000 x1874433577961088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599423.561933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577961088:0@lo:400:kworker.0 00010000:00010000:0.0:1787599423.717458:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599424.040604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599424.040643:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577961344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599424.040724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599424.040855:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961344 00000100:00100000:2.0:1787599424.040863:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961344 00000100:00100000:2.0:1787599424.040912:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787599424.040923:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577961344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599424.040951:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599424.040997:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577961344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599424.041004:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1787599424.041058:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2437b4a80 x1874433577961344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599424.041078:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577961344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599424.042825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599424.042844:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577961472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599424.042900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.043215:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961472 00000100:00100000:0.0:1787599424.043222:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961472 00000100:00100000:0.0:1787599424.043270:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599424.043279:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577961472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599424.043300:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599424.043356:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577961472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.043379:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1787599424.045981:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d1c00 x1874433577961472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599424.046024:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577961472:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787599424.741307:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599425.061231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599425.061251:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2437b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577961600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599425.061319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599425.061406:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961600 00000100:00100000:3.0:1787599425.061412:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961600 00000100:00100000:3.0:1787599425.061453:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787599425.061460:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577961600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599425.061487:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599425.061575:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577961600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599425.061583:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787599425.061666:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2437b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577961600:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599425.767565:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599426.502533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599426.502723:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998784 00000100:00100000:2.0:1787599426.502732:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998784 00000100:00100000:2.0:1787599426.502842:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999296 00000100:00100000:2.0:1787599426.502846:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999296 00000100:00100000:2.0:1787599426.502863:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998912 00000100:00100000:2.0:1787599426.502879:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998912 00000100:00100000:2.0:1787599426.502895:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999168 00000100:00100000:2.0:1787599426.502898:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999168 00000100:00100000:2.0:1787599426.502912:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:2.0:1787599426.502922:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558998784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599426.503000:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558998784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599426.503009:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:2.0:1787599426.503026:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1787599426.503033:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558999296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599426.503060:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558999296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599426.503066:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1787599426.503078:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:2.0:1787599426.503083:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558998912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599426.503105:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558998912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599426.503111:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:2.0:1787599426.503122:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:2.0:1787599426.503128:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558999168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599426.503149:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433558999168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599426.503155:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00080000:2.0:1787599426.503175:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599426.503180:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599426.503525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558998656 00000100:00100000:3.0:1787599426.503531:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558998656 00000100:00100000:3.0:1787599426.503570:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:3.0:1787599426.503577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558998656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599426.503605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433558998656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599426.503612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:3.0:1787599426.503641:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999040 00000100:00100000:3.0:1787599426.503644:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999040 00000100:00100000:3.0:1787599426.503688:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1787599426.503694:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558999040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599426.503732:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433558999040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599426.503748:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00080000:1.0:1787599426.504068:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599426.598232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599426.598255:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577961728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599426.598327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599426.598412:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961728 00000100:00100000:0.0:1787599426.598420:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961728 00000100:00100000:0.0:1787599426.598491:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787599426.598502:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577961728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599426.598534:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599426.598579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577961728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599426.598586:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787599426.598632:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577961728:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787599426.601629:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1787599426.789102:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599427.813510:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599428.645240:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577961984:0@lo:400:kworker.0 00000100:00100000:2.0:1787599428.645310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577962112:0@lo:400:kworker.0 00000100:00100000:1.0:1787599428.645385:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577962240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599428.645431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599428.645432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.645500:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577961856:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662366:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577962368:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662439:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577962880:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577963392:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662552:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787599428.662559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577963008:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577963520:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.662660:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962368 00000100:00100000:3.0:1787599428.662668:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962368 00000100:00100000:3.0:1787599428.662716:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787599428.662726:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577962368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662778:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577962368:12345-0@lo:400:kworker.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.662785:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787599428.662825:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962880 00000100:00100000:3.0:1787599428.662829:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962880 00000100:00100000:3.0:1787599428.662875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963392 00000100:00100000:3.0:1787599428.662878:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963392 00000100:00100000:3.0:1787599428.662888:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963008 00000100:00100000:3.0:1787599428.662890:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963008 00000100:00100000:3.0:1787599428.662901:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963520 00000100:00100000:3.0:1787599428.662903:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963520 00000100:00100000:3.0:1787599428.662913:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787599428.662918:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577962880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.662957:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577962880:12345-0@lo:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.662965:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787599428.662977:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787599428.662983:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577963392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.663008:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577963392:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.663013:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787599428.663023:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599428.663030:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577963008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.663499:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577963008:12345-0@lo:400:kworker.0 Request processed in 468us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.663509:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599428.663524:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787599428.663531:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577963520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.663562:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577963520:12345-0@lo:400:kworker.0 Request processed in 33us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.663567:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787599428.663584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599428.663593:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599428.663627:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787599428.663815:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b243754a80, transno 4294967301 00000100:00100000:3.0:1787599428.666443:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577963008:0@lo:400:kworker.0 00010000:00080000:3.0:1787599428.666507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243757b80 x1874433577963520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599428.666522:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577963520:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.666538:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577962368:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.666550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577962880:0@lo:400:kworker.0 00010000:00080000:3.0:1787599428.666563:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243756300 x1874433577963392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599428.666570:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577963392:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.666771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961856 00000100:00100000:3.0:1787599428.666779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961856 00000100:00100000:3.0:1787599428.666841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787599428.666850:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577961856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.666937:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b344f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577961856:12345-0@lo:400:kworker.0 Request processed in 88us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.666944:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787599428.666986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577961856:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.667038:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962240 00000100:00100000:3.0:1787599428.667042:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962240 00000100:00100000:3.0:1787599428.670736:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599428.670751:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577962240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599428.670815:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599428.670905:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577962240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (25477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.670912:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599428.670945:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962112 00000100:00100000:3.0:1787599428.670953:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962112 00000100:00100000:3.0:1787599428.670981:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787599428.670986:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577962112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.671021:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577962112:12345-0@lo:400:kworker.0 Request processed in 36us (25595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.671027:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787599428.672995:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577962112:0@lo:400:kworker.0 00000100:00100000:0.0:1787599428.672995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599428.673012:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577962624:0@lo:400:kworker.0 00000100:00100000:2.0:1787599428.675929:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577961984 00000100:00100000:2.0:1787599428.675945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577961984 00000100:00100000:2.0:1787599428.676160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787599428.676172:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577961984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.677313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.677371:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577963136:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.677439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599428.677483:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962624 00000100:00100000:3.0:1787599428.677489:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962624 00000100:00100000:3.0:1787599428.680343:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963136 00000100:00100000:3.0:1787599428.680356:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963136 00000100:00100000:3.0:1787599428.680410:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787599428.680420:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577962624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.680771:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577962624:12345-0@lo:400:kworker.0 Request processed in 351us (3459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.680779:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787599428.680814:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787599428.680822:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577963136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.680854:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577963136:12345-0@lo:400:kworker.0 Request processed in 34us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.680875:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1787599428.680901:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599428.680944:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577963136:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.680975:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577963648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599428.681151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599428.681308:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577962496:0@lo:400:kworker.0 00000100:00100000:0.0:1787599428.681339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599428.681363:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962496 00000100:00100000:0.0:1787599428.681368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962496 00000100:00100000:0.0:1787599428.681482:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787599428.681491:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577962496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.681651:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577962624:0@lo:400:kworker.0 00000100:00100000:1.0:1787599428.681855:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577962240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599428.681865:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577962752:0@lo:400:kworker.0 00000100:00100000:1.0:1787599428.681895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599428.684973:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577962496:12345-0@lo:400:kworker.0 Request processed in 3471us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599428.684988:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787599428.685071:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577962496:0@lo:400:kworker.0 00000100:00100000:0.0:1787599428.685162:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577962752 00000100:00100000:1.0:1787599428.685624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577963264:0@lo:400:kworker.0 00000100:00100000:1.0:1787599428.685788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599428.685843:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963264 00000100:00100000:1.0:1787599428.685850:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963264 00000100:00100000:1.0:1787599428.685905:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787599428.685914:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577963264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599428.685964:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433577963264:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599428.685970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1787599428.685993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787599428.686014:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87d180 x1874433577963264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599428.686026:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433577963264:0@lo:400:kworker.0 00000100:00100000:3.0:1787599428.686138:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963648 00000100:00100000:3.0:1787599428.686143:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963648 00000100:00100000:3.0:1787599428.686180:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599428.686314:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577963648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599428.686332:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599428.686376:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577963648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (5226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.686382:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599428.686418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577963648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599428.686549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b241090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577961984:12345-0@lo:400:kworker.0 Request processed in 10379us (13556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599428.686557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787599428.686968:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577962752 00000100:00100000:0.0:1787599428.687016:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787599428.687025:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577962752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599428.687069:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577962752:12345-0@lo:400:kworker.0 Request processed in 46us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599428.687075:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787599428.687167:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577961984:0@lo:400:kworker.0 00010000:00080000:1.0:1787599428.687301:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369df80 x1874433577962752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599428.687329:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577962752:0@lo:400:kworker.0 00000100:00080000:2.0:1787599428.687410:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787599428.837859:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599429.158826:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599429.158851:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577963776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599429.158925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599429.159055:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963776 00000100:00100000:0.0:1787599429.159064:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963776 00000100:00100000:0.0:1787599429.159122:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787599429.159132:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577963776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599429.159162:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599429.159226:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577963776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.159233:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1787599429.159569:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243663b80 x1874433577963776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599429.159586:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577963776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599429.160032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599429.160044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577963904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599429.160079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599429.160149:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577963904 00000100:00100000:3.0:1787599429.160154:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577963904 00000100:00100000:3.0:1787599429.160201:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787599429.160209:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577963904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599429.160240:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599429.160281:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577963904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599429.160288:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1787599429.160414:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24369c380 x1874433577963904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599429.160428:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577963904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599429.861041:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599430.184281:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577964032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599430.184361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599430.184781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964032 00000100:00100000:3.0:1787599430.184841:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964032 00000100:00100000:3.0:1787599430.184902:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787599430.184913:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577964032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599430.184949:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787599430.185010:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577964032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599430.185018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787599430.185162:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577964032:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599430.885585:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599431.630237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599431.630280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599431.630307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599431.630333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599431.630361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999552 00000100:00100000:3.0:1787599431.630371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999552 00000100:00100000:3.0:1787599431.630444:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999680 00000100:00100000:3.0:1787599431.630448:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999680 00000100:00100000:3.0:1787599431.630466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999936 00000100:00100000:3.0:1787599431.630469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999936 00000100:00100000:3.0:1787599431.630489:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:3.0:1787599431.630500:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558999552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599431.630586:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558999552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 88us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.630593:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:3.0:1787599431.630643:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:3.0:1787599431.630651:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558999680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599431.630681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433558999680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.630687:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:3.0:1787599431.630699:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:3.0:1787599431.630705:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433558999936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599431.630729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433558999936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.630735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:3.0:1787599431.630770:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999424 00000100:00100000:3.0:1787599431.630774:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999424 00000100:00100000:3.0:1787599431.630839:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00100000:3.0:1787599431.630846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433558999424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599431.630873:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433558999424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.630879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00080000:3.0:1787599431.630919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599431.630924:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599431.643918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599431.643965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599431.643994:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433558999808 00000100:00100000:3.0:1787599431.644008:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433558999808 00000100:00100000:3.0:1787599431.644084:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1787599431.644094:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558999808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599431.644098:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000064 00000100:00100000:2.0:1787599431.644102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000064 00000100:00100000:2.0:1787599431.644134:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:2.0:1787599431.644147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599431.644179:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433558999808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599431.644179:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599431.644186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:3.0:1787599431.644194:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00080000:0.0:1787599431.644852:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599431.644859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599431.717004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577964160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599431.717084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599431.717555:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964160 00000100:00100000:1.0:1787599431.717566:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964160 00000100:00100000:1.0:1787599431.717632:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787599431.717642:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577964160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599431.717678:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599431.717730:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577964160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599431.717737:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787599431.717812:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577964160:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787599431.911766:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599432.805535:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787599432.807747:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599432.934307:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599433.765372:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577964416:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765516:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577964928:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577965440:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787599433.765638:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577964544:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765681:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577965056:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765718:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577965568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599433.765765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964416 00000100:00100000:0.0:1787599433.765773:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964416 00000100:00100000:0.0:1787599433.765848:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964928 00000100:00100000:0.0:1787599433.765851:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964928 00000100:00100000:0.0:1787599433.765873:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965440 00000100:00100000:0.0:1787599433.765875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965440 00000100:00100000:0.0:1787599433.765886:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965056 00000100:00100000:0.0:1787599433.765888:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965056 00000100:00100000:0.0:1787599433.765899:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965568 00000100:00100000:0.0:1787599433.765901:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965568 00000100:00100000:0.0:1787599433.765916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787599433.765923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577964416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.765987:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577964416:12345-0@lo:400:kworker.0 Request processed in 65us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.765994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787599433.766010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787599433.766016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577964928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577964928:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.766046:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787599433.766066:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787599433.766071:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577965440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766096:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577965440:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.766101:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787599433.766110:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787599433.766116:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577965056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577965056:12345-0@lo:400:kworker.0 Request processed in 21us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.766141:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787599433.766150:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787599433.766155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577965568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577965568:12345-0@lo:400:kworker.0 Request processed in 22us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.766180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787599433.766205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964544 00000100:00100000:0.0:1787599433.766208:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964544 00000100:00100000:0.0:1787599433.766231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787599433.766237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577964544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766268:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577964544:12345-0@lo:400:kworker.0 Request processed in 31us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599433.766273:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787599433.766287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599433.766291:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599433.766316:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577964544:0@lo:400:kworker.0 00010000:00080000:0.0:1787599433.766329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436e5880 x1874433577965056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599433.766345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577965056:0@lo:400:kworker.0 00010000:00080000:0.0:1787599433.766356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f9f80 x1874433577965568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599433.766365:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577965568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766374:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577964416:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766383:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577964928:0@lo:400:kworker.0 00000100:00100000:0.0:1787599433.766391:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577965440:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.766974:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577964672:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767039:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577965184:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767078:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577965696:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767117:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787599433.767124:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577964288:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767179:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577964800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767219:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577965312:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577965824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.767296:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964800 00000100:00100000:1.0:1787599433.767301:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964800 00000100:00100000:1.0:1787599433.767509:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599433.767518:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577964800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767561:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577964800:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599433.767568:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599433.767598:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577964800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964672 00000100:00100000:1.0:1787599433.767619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964672 00000100:00100000:1.0:1787599433.767641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787599433.767647:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577964672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.767680:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577964672:12345-0@lo:400:kworker.0 Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599433.767686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787599433.767711:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577964672:0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.767782:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965184 00000100:00100000:3.0:1787599433.767787:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965184 00000100:00100000:3.0:1787599433.767835:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965696 00000100:00100000:3.0:1787599433.767838:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965696 00000100:00100000:3.0:1787599433.767849:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965312 00000100:00100000:3.0:1787599433.767851:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965312 00000100:00100000:3.0:1787599433.767862:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965824 00000100:00100000:3.0:1787599433.767865:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965824 00000100:00100000:3.0:1787599433.767877:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787599433.767883:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577965184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.767916:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577965184:12345-0@lo:400:kworker.0 Request processed in 33us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.767922:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787599433.767931:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599433.767936:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577965696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.767967:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577965696:12345-0@lo:400:kworker.0 Request processed in 31us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.767972:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599433.767981:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599433.767986:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.768008:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577965312:12345-0@lo:400:kworker.0 Request processed in 22us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.768020:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599433.768029:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599433.768034:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577965824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.768054:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577965824:12345-0@lo:400:kworker.0 Request processed in 21us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.768059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599433.768075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577964288 00000100:00100000:3.0:1787599433.768078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577964288 00000100:00100000:3.0:1787599433.768098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787599433.768103:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577964288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599433.768125:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577964288:12345-0@lo:400:kworker.0 Request processed in 22us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.768130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787599433.768165:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577965952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599433.768186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599433.768210:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577965952 00000100:00100000:3.0:1787599433.768213:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577965952 00000100:00100000:3.0:1787599433.768232:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787599433.768237:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577965952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599433.768256:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599433.768283:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577965952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599433.768289:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787599433.768313:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b345e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577965952:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787599433.768493:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599433.768497:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599433.768512:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577964288:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.768531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577965312:0@lo:400:kworker.0 00010000:00080000:1.0:1787599433.768542:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f8000 x1874433577965824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599433.768552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577965824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599433.768559:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577965184:0@lo:400:kworker.0 00010000:00080000:1.0:1787599433.768568:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436f9880 x1874433577965696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599433.768575:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577965696:0@lo:400:kworker.0 00000100:00100000:2.0:1787599433.770197:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577966080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599433.770265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599433.775540:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966080 00000100:00100000:1.0:1787599433.775556:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966080 00000100:00100000:1.0:1787599433.775635:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599433.775646:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577966080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599433.775675:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599433.789710:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577966080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14055us (19433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599433.789724:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787599433.795143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577966080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787599433.963639:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599434.277339:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577966208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599434.277443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599434.277679:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966208 00000100:00100000:0.0:1787599434.277688:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966208 00000100:00100000:0.0:1787599434.277743:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787599434.277753:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577966208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599434.277779:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599434.277842:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577966208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599434.277849:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1787599434.277930:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433577966208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599434.277948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577966208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599434.278583:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577966336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599434.278631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599434.278748:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966336 00000100:00100000:1.0:1787599434.278761:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966336 00000100:00100000:1.0:1787599434.278817:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787599434.278825:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577966336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599434.278838:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599434.278877:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577966336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599434.278883:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1787599434.278990:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b45c00 x1874433577966336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599434.279003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577966336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599434.981010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599435.301225:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599435.301247:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577966464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599435.301329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599435.301511:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966464 00000100:00100000:1.0:1787599435.301520:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966464 00000100:00100000:1.0:1787599435.301577:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787599435.301587:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577966464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599435.301620:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787599435.301673:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577966464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599435.301680:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787599435.301821:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577966464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599436.006827:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599436.744021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599436.744134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599436.744185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599436.744217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000448 00000100:00100000:3.0:1787599436.744227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000448 00000100:00100000:3.0:1787599436.744284:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000320 00000100:00100000:3.0:1787599436.744287:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000320 00000100:00100000:3.0:1787599436.744312:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:3.0:1787599436.744321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559000448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599436.744403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559000448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599436.744410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:3.0:1787599436.744426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:3.0:1787599436.744432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559000320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599436.744457:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559000320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599436.744462:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00080000:1.0:1787599436.745598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599436.745606:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599436.750225:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000192 00000100:00100000:2.0:1787599436.750244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000192 00000100:00100000:2.0:1787599436.750319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 373 00000100:00100000:2.0:1787599436.750331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559000192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599436.750450:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559000192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 120us (6438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599436.750458:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 373 00000100:00100000:3.0:1787599436.759704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599436.761437:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000576 00000100:00100000:0.0:1787599436.761451:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000576 00000100:00100000:0.0:1787599436.761544:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1787599436.761555:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2402:x1874433559000576:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1787599436.761586:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf4e3 00000100:00080000:0.0:1787599436.761595:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96b2419ce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599436.761648:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1787599436.761856:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+2:2402:x1874433559000576:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 302us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599436.761865:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00080000:1.0:1787599436.762281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599436.762334:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599436.773018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599436.773079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599436.778210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000704 00000100:00100000:3.0:1787599436.778237:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000704 00000100:00100000:3.0:1787599436.778396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000832 00000100:00100000:3.0:1787599436.778400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000832 00000100:00100000:3.0:1787599436.778435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:3.0:1787599436.778465:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599436.778583:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 138us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599436.778751:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:1.0:1787599436.778762:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599436.778848:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559000832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599436.778856:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00080000:1.0:1787599436.778891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599436.778895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599436.780352:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:1.0:1787599436.837237:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599436.837277:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577966592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599436.837364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599436.838745:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966592 00000100:00100000:2.0:1787599436.838772:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966592 00000100:00100000:2.0:1787599436.838871:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787599436.838882:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577966592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599436.838928:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599436.839000:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577966592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599436.839008:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787599436.839833:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577966592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599437.029863:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599438.053112:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599438.885083:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599438.885108:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577966720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599438.885179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599438.885404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577966848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599438.885656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599438.885695:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966720 00000100:00100000:0.0:1787599438.885704:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966720 00000100:00100000:0.0:1787599438.885757:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966848 00000100:00100000:0.0:1787599438.885761:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966848 00000100:00100000:0.0:1787599438.885781:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599438.885790:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577966720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599438.885843:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599438.885890:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577966720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599438.885898:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599438.885915:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599438.885922:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577966848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599438.885932:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599438.885957:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577966848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599438.885963:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787599438.885980:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599438.886022:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577966848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599438.886059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577966720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599438.886428:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577967360:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.886856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599438.886887:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577967872:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.886911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599438.886930:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787599438.886935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577967232:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.886960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599438.886977:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.886999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599438.887014:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577968256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.887035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599438.887065:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968256 00000100:00100000:3.0:1787599438.887070:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968256 00000100:00100000:3.0:1787599438.887110:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599438.887119:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577968256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.887160:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577968256:12345-0@lo:400:kworker.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599438.887167:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1787599438.887199:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b3800 x1874433577968256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599438.887211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577968256:0@lo:400:kworker.0 00000100:00100000:2.0:1787599438.887321:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967360 00000100:00100000:2.0:1787599438.887326:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967360 00000100:00100000:2.0:1787599438.887389:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967872 00000100:00100000:2.0:1787599438.887392:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967872 00000100:00100000:2.0:1787599438.887415:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967744 00000100:00100000:2.0:1787599438.887417:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967744 00000100:00100000:2.0:1787599438.887433:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787599438.887452:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577967360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599438.887493:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577967360:12345-0@lo:400:kworker.0 Request processed in 42us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599438.887499:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787599438.887512:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787599438.887519:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577967872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599438.887546:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433577967872:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599438.887552:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787599438.887563:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787599438.887569:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577967744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599438.887825:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577967744:12345-0@lo:400:kworker.0 Request processed in 256us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599438.887841:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787599438.887865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967232 00000100:00100000:2.0:1787599438.887869:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967232 00000100:00100000:2.0:1787599438.887895:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787599438.887901:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577967232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599438.887936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577967232:12345-0@lo:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599438.887941:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599438.888029:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577967232:0@lo:400:kworker.0 00010000:00080000:3.0:1787599438.888041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435afb80 x1874433577967744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599438.888050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.888059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577967360:0@lo:400:kworker.0 00000100:00100000:3.0:1787599438.888068:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433577967872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888147:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577967104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888208:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577967616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888257:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968128:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888300:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787599438.888306:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577966976:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888383:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577967488:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888426:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577968000:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599438.888636:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967104 00000100:00100000:1.0:1787599438.888641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967104 00000100:00100000:1.0:1787599438.888660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967616 00000100:00100000:1.0:1787599438.888663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967616 00000100:00100000:1.0:1787599438.888675:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968000 00000100:00100000:1.0:1787599438.888676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968000 00000100:00100000:1.0:1787599438.888689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787599438.888695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577967104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577967104:12345-0@lo:400:kworker.0 Request processed in 37us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.888750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787599438.888766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787599438.888772:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577967616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577967616:12345-0@lo:400:kworker.0 Request processed in 60us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.888837:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787599438.888847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787599438.888853:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577968000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577968000:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.888882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787599438.888902:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968128 00000100:00100000:1.0:1787599438.888905:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968128 00000100:00100000:1.0:1787599438.888929:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787599438.888936:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.888965:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968128:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.888971:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787599438.888989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577966976 00000100:00100000:1.0:1787599438.888993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577966976 00000100:00100000:1.0:1787599438.889015:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787599438.889022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577966976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.889053:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577966976:12345-0@lo:400:kworker.0 Request processed in 32us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.889059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787599438.889093:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577967488 00000100:00100000:1.0:1787599438.889097:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577967488 00000100:00100000:1.0:1787599438.889118:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599438.889124:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577967488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.889157:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577967488:12345-0@lo:400:kworker.0 Request processed in 33us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599438.889163:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599438.889194:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577966976:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.889205:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577967488:0@lo:400:kworker.0 00010000:00080000:1.0:1787599438.889217:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b2a00 x1874433577968000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599438.889226:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577968000:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.889237:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577967104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599438.889246:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577967616:0@lo:400:kworker.0 00010000:00080000:1.0:1787599438.889254:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2435b3b80 x1874433577968128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599438.889261:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968128:0@lo:400:kworker.0 00000100:00080000:0.0:1787599438.889837:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599438.889843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599438.889846:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787599439.077197:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599439.400200:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599439.400228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577968384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599439.400322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599439.400974:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968384 00000100:00100000:1.0:1787599439.400985:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968384 00000100:00100000:1.0:1787599439.401039:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599439.401049:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577968384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599439.401091:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599439.401148:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577968384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599439.401174:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1787599439.401733:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f84f800 x1874433577968384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599439.401754:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577968384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599439.401876:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599439.401888:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599439.401930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599439.402036:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968512 00000100:00100000:0.0:1787599439.402042:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968512 00000100:00100000:0.0:1787599439.402090:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599439.402099:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599439.402113:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599439.402157:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599439.402164:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1787599439.402193:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b242c2df80 x1874433577968512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599439.402206:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968512:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787599440.101064:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599440.421012:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599440.421107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599440.421271:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968640 00000100:00100000:2.0:1787599440.421280:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968640 00000100:00100000:2.0:1787599440.421331:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787599440.421341:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599440.421407:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599440.425170:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577968640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3818us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599440.425187:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787599440.426502:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577968640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599441.131562:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599441.871268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599441.871318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599441.871352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599441.871376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599441.871400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599441.871429:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001216 00000100:00100000:1.0:1787599441.871439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001216 00000100:00100000:1.0:1787599441.871500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001472 00000100:00100000:1.0:1787599441.871504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001472 00000100:00100000:1.0:1787599441.871519:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001088 00000100:00100000:1.0:1787599441.871521:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001088 00000100:00100000:1.0:1787599441.871533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001344 00000100:00100000:1.0:1787599441.871536:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001344 00000100:00100000:1.0:1787599441.871551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:1.0:1787599441.871563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559001216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599441.871639:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559001216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599441.871646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:1.0:1787599441.871665:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:1.0:1787599441.871672:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559001472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599441.871698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559001472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599441.871704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:1.0:1787599441.871716:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:1.0:1787599441.871723:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559001088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599441.871771:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559001088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599441.871778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:1.0:1787599441.871817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:1.0:1787599441.871825:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559001344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599441.871848:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559001344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599441.871854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:3.0:1787599441.874105:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559000960 00000100:00100000:3.0:1787599441.874124:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559000960 00000100:00100000:3.0:1787599441.874190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 375 00000100:00100000:3.0:1787599441.874201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433559000960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599441.874268:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433559000960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599441.874276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 375 00000100:00080000:0.0:1787599441.874951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599441.874957:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599441.963578:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577968768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599441.963644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599441.963725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968768 00000100:00100000:2.0:1787599441.963734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968768 00000100:00100000:2.0:1787599441.963780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599441.963788:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577968768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599441.963833:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599441.967041:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577968768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3246us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599441.967094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599441.967179:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577968768:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787599442.021608:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787599442.023209:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599442.152489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599442.474694:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:3.0:1787599442.474704:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b3819f4000/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:2.0:1787599442.474778:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3819f4000/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-OST0000 00000020:00000080:2.0:1787599442.474866:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2419ce000 for lustre-OST0000 00010000:00010000:3.0:1787599443.176625:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599444.005374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577968896:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005488:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577969024:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005523:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577969408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005558:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577969536:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005584:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577969920:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005628:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577970048:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577970432:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005687:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787599444.005696:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577969152:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005699:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787599444.005707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577969280:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577969664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005778:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577969792:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005831:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577970176:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.005851:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577970304:0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.005883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.005889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.005925:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969024 00000100:00100000:2.0:1787599444.005931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577968896 00000100:00100000:3.0:1787599444.005934:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969024 00000100:00100000:2.0:1787599444.005937:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577968896 00000100:00100000:3.0:1787599444.005979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969536 00000100:00100000:3.0:1787599444.005984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969536 00000100:00100000:2.0:1787599444.005988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787599444.005999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577968896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970048 00000100:00100000:3.0:1787599444.006018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970048 00000100:00100000:3.0:1787599444.006037:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969280 00000100:00100000:3.0:1787599444.006040:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969280 00000100:00100000:2.0:1787599444.006052:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577968896:12345-0@lo:400:kworker.0 Request processed in 55us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787599444.006067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969664 00000100:00100000:3.0:1787599444.006073:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969664 00000100:00100000:3.0:1787599444.006091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970176 00000100:00100000:3.0:1787599444.006093:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970176 00000100:00100000:2.0:1787599444.006096:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969408 00000100:00100000:2.0:1787599444.006101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969408 00000100:00100000:3.0:1787599444.006112:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787599444.006122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577969024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006129:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969152 00000100:00100000:2.0:1787599444.006132:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969152 00000100:00100000:2.0:1787599444.006146:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599444.006153:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006185:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577969408:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006191:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599444.006201:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599444.006207:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577969152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006239:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577969152:12345-0@lo:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006244:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599444.006262:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969920 00000100:00100000:2.0:1787599444.006265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969920 00000100:00100000:2.0:1787599444.006283:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970432 00000100:00100000:2.0:1787599444.006286:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970432 00000100:00100000:2.0:1787599444.006297:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577969792 00000100:00100000:2.0:1787599444.006300:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577969792 00000100:00100000:2.0:1787599444.006322:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970304 00000100:00100000:2.0:1787599444.006338:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970304 00000100:00100000:2.0:1787599444.006354:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787599444.006361:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577969920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006399:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577969024:12345-0@lo:400:kworker.0 Request processed in 278us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006405:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577969920:12345-0@lo:400:kworker.0 Request processed in 43us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599444.006413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787599444.006417:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787599444.006440:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787599444.006443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787599444.006450:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577970432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006465:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577969536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006484:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577970432:12345-0@lo:400:kworker.0 Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006490:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787599444.006507:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787599444.006512:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577969536:12345-0@lo:400:kworker.0 Request processed in 48us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006519:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577969792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006525:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787599444.006544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787599444.006553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577970048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006558:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577969792:12345-0@lo:400:kworker.0 Request processed in 41us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006566:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599444.006579:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787599444.006588:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577970304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006593:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577970048:12345-0@lo:400:kworker.0 Request processed in 40us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599444.006599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787599444.006616:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787599444.006626:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577970304:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599444.006627:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577969280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006638:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787599444.006667:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577969280:12345-0@lo:400:kworker.0 Request processed in 44us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006673:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787599444.006681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787599444.006686:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577969664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599444.006702:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787599444.006711:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577970176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006723:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577969664:12345-0@lo:400:kworker.0 Request processed in 40us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.006740:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787599444.006747:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577970176:12345-0@lo:400:kworker.0 Request processed in 37us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599444.006755:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1787599444.006822:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599444.006827:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599444.006829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599444.006831:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599444.006837:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577969152:0@lo:400:kworker.0 00010000:00080000:2.0:1787599444.006853:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2434e8380 x1874433577969664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599444.006863:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577969664:0@lo:400:kworker.0 00010000:00080000:2.0:1787599444.006873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412af800 x1874433577970176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599444.006881:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577970176:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006892:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577969024:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006903:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577969536:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006913:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577970048:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006968:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577969280:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.006978:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577969792:0@lo:400:kworker.0 00010000:00080000:2.0:1787599444.006987:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3412adf80 x1874433577970304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599444.006995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3412adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577970304:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.007005:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577969408:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.007014:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577969920:0@lo:400:kworker.0 00010000:00080000:2.0:1787599444.007023:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243676a00 x1874433577970432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599444.007039:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577970432:0@lo:400:kworker.0 00000100:00100000:2.0:1787599444.007050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577968896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599444.012116:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599444.012140:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577970560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599444.012217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599444.013579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599444.013596:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577970688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599444.013663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.017416:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970560 00000100:00100000:2.0:1787599444.017429:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970560 00000100:00100000:2.0:1787599444.017494:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970688 00000100:00100000:2.0:1787599444.017498:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970688 00000100:00100000:2.0:1787599444.017517:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787599444.017526:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577970560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599444.017556:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599444.017634:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577970560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.017642:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787599444.017660:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787599444.017667:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577970688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599444.017676:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599444.017706:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577970688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (4043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.017713:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787599444.017881:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577970560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599444.020526:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577970688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787599444.196902:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599444.517158:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577970816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599444.517227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.517308:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970816 00000100:00100000:2.0:1787599444.517317:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970816 00000100:00100000:2.0:1787599444.517379:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787599444.517389:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577970816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599444.517427:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599444.519216:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577970816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1821us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.519231:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787599444.519276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577970944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599444.519348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599444.519403:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577970944 00000100:00100000:2.0:1787599444.519409:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577970944 00000100:00100000:2.0:1787599444.519448:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787599444.519455:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577970944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599444.519474:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599444.519512:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577970944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599444.519518:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1787599444.519548:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243676d80 x1874433577970944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599444.519566:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577970944:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787599444.520084:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c2a00 x1874433577970816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599444.520099:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577970816:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787599445.222959:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599445.545562:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599445.545585:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577971072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599445.545678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599445.545749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971072 00000100:00100000:2.0:1787599445.545757:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971072 00000100:00100000:2.0:1787599445.545822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599445.545832:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577971072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599445.545867:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787599445.545937:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577971072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599445.545944:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599445.545994:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577971072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599446.252829:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599446.983440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599446.983487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599446.983529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599446.983568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599446.983598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599446.983626:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001856 00000100:00100000:1.0:1787599446.983638:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001856 00000100:00100000:0.0:1787599446.983904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002112 00000100:00100000:0.0:1787599446.983909:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002112 00000100:00100000:0.0:1787599446.983973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001728 00000100:00100000:0.0:1787599446.983976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001728 00000100:00100000:0.0:1787599446.983990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001984 00000100:00100000:0.0:1787599446.983993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001984 00000100:00100000:0.0:1787599446.984012:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:0.0:1787599446.984022:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559002112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599446.984110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559002112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 89us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599446.984119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:0.0:1787599446.984140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 270 00000100:00100000:0.0:1787599446.984147:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559001728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599446.984170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559001600 00000100:00100000:0.0:1787599446.984174:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559001728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599446.984175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559001600 00000100:00100000:0.0:1787599446.984180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 270 00000100:00100000:0.0:1787599446.984190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:0.0:1787599446.984196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559001984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599446.984206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 377 00000100:00100000:3.0:1787599446.984211:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559001600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599446.984216:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559001984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599446.984233:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559001600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599446.984235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:3.0:1787599446.984239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 377 00000100:00080000:0.0:1787599446.984252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599446.984255:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599446.993587:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599446.993820:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 272 00000100:00100000:0.0:1787599446.993834:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559001856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599446.994486:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559001856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 653us (10994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599446.994568:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 272 00000100:00100000:3.0:1787599447.077508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599447.079749:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577971200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599447.079980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599447.080430:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971200 00000100:00100000:2.0:1787599447.080441:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971200 00000100:00100000:2.0:1787599447.080606:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787599447.080619:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577971200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599447.080663:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599447.080767:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577971200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599447.080775:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787599447.081053:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577971200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787599447.270728:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599448.145538:0:14066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:24:06 (1787599446) 00010000:00010000:2.0:1787599448.293101:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599449.125129:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577971328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599449.125208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599449.125239:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577971584:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.125316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.128833:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577971840:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.128951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.129016:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577972352:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.129047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.129072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577972864:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.129093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.129119:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787599449.129125:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577971712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.129146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599449.129331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577971456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599449.129373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599449.130605:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577972096:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.135356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599449.135429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577972608:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.135467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.135959:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577972224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.135990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.136010:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577972736:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599449.136094:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971840 00000100:00100000:0.0:1787599449.136104:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971840 00000100:00100000:0.0:1787599449.136164:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972096 00000100:00100000:0.0:1787599449.136168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972096 00000100:00100000:0.0:1787599449.136186:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599449.136196:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577971840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136255:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577971840:12345-0@lo:400:kworker.0 Request processed in 61us (7304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599449.136287:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787599449.136295:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577972096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136323:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577972096:12345-0@lo:400:kworker.0 Request processed in 30us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136329:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787599449.136346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972352 00000100:00100000:0.0:1787599449.136349:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972352 00000100:00100000:0.0:1787599449.136377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972864 00000100:00100000:0.0:1787599449.136380:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972864 00000100:00100000:0.0:1787599449.136394:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971712 00000100:00100000:0.0:1787599449.136396:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971712 00000100:00100000:0.0:1787599449.136418:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972224 00000100:00100000:0.0:1787599449.136421:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972224 00000100:00100000:0.0:1787599449.136433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972736 00000100:00100000:0.0:1787599449.136436:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972736 00000100:00100000:0.0:1787599449.136462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787599449.136468:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577972352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136500:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433577972352:12345-0@lo:400:kworker.0 Request processed in 33us (7453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136506:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787599449.136525:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787599449.136530:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577972864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433577972864:12345-0@lo:400:kworker.0 Request processed in 43us (7479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787599449.136592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787599449.136598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577971712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136635:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577971712:12345-0@lo:400:kworker.0 Request processed in 28us (7477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787599449.136653:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787599449.136659:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577972224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136685:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577972224:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787599449.136701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787599449.136707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577972736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136731:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577972736:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.136736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1787599449.136759:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599449.136763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599449.136811:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577971712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136826:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577972224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136835:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577972736:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.136856:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577971840:0@lo:400:kworker.0 00010000:00080000:0.0:1787599449.136870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138c380 x1874433577972352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599449.136880:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433577972352:0@lo:400:kworker.0 00010000:00080000:0.0:1787599449.136890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243681f80 x1874433577972864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599449.136898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433577972864:0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.137178:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971584 00000100:00100000:0.0:1787599449.137183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971584 00000100:00100000:0.0:1787599449.137215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1787599449.137223:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577971584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599449.137261:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3646:x1874433577971584:12345-0@lo:400:kworker.0 Request processed in 39us (11945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599449.137267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787599449.138873:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577971968:0@lo:400:kworker.0 00000100:00100000:1.0:1787599449.138932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599449.138967:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577972480:0@lo:400:kworker.0 00000100:00100000:1.0:1787599449.139017:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971968 00000100:00100000:1.0:1787599449.139023:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971968 00000100:00100000:1.0:1787599449.139064:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787599449.139074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577971968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599449.139139:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577971968:12345-0@lo:400:kworker.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599449.139148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787599449.139870:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577973120:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.139907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599449.139944:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3646:1874433577971584:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.139979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577972096:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.140020:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972608 00000100:00100000:3.0:1787599449.140025:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972608 00000100:00100000:3.0:1787599449.140062:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577973120 00000100:00100000:3.0:1787599449.140073:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577973120 00000100:00100000:3.0:1787599449.140097:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787599449.140104:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577972608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.140291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577972608:12345-0@lo:400:kworker.0 Request processed in 176us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599449.140298:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787599449.140312:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787599449.140319:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577973120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.140347:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577973120:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599449.140353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787599449.140371:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599449.140376:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599449.140394:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577972608:0@lo:400:kworker.0 00010000:00080000:3.0:1787599449.140416:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243682a00 x1874433577973120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599449.140426:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577973120:0@lo:400:kworker.0 00000100:00100000:1.0:1787599449.140556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599449.140588:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577972992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599449.140611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599449.140652:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577971968:0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.140770:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972480 00000100:00100000:3.0:1787599449.140774:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972480 00000100:00100000:3.0:1787599449.140831:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577972992 00000100:00100000:3.0:1787599449.140834:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577972992 00000100:00100000:3.0:1787599449.140851:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787599449.140948:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599449.140951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599449.140991:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577972480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.141037:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577972480:12345-0@lo:400:kworker.0 Request processed in 50us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599449.141043:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787599449.141065:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787599449.141071:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577972992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599449.141101:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577972992:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599449.141107:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599449.141242:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577972480:0@lo:400:kworker.0 00010000:00080000:1.0:1787599449.141253:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243680700 x1874433577972992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599449.141262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577972992:0@lo:400:kworker.0 00000100:00100000:2.0:1787599449.141330:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971328 00000100:00100000:2.0:1787599449.141336:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971328 00000100:00100000:2.0:1787599449.141371:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577971456 00000100:00100000:2.0:1787599449.141375:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577971456 00000100:00100000:2.0:1787599449.141389:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787599449.141396:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577971328:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599449.141485:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787599449.141494:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577971456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599449.141519:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599449.141567:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577971456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (12194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599449.141574:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00002000:00000024:2.0:1787599449.141617:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599449.141716:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577971328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 319us (16508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599449.141722:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787599449.141831:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577971328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599449.141848:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577971456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787599449.316975:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599449.638964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599449.639005:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577973248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599449.639083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599449.639574:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577973248 00000100:00100000:2.0:1787599449.639584:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577973248 00000100:00100000:2.0:1787599449.639644:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787599449.639657:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577973248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599449.639704:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599449.639779:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577973248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599449.639788:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:1.0:1787599449.640014:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c0700 x1874433577973248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599449.640035:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577973248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599449.640566:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577973376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599449.640604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599449.641032:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577973376 00000100:00100000:2.0:1787599449.641042:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577973376 00000100:00100000:2.0:1787599449.641085:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787599449.641094:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577973376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599449.641111:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599449.641161:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577973376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599449.641167:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1787599449.641237:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243677800 x1874433577973376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599449.641254:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577973376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599450.146224:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599450.146331:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002240 00000100:00100000:0.0:1787599450.146341:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002240 00000100:00100000:0.0:1787599450.146428:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1787599450.146440:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:11085:x1874433559002240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599450.146459:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599450.146496:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbae1 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146561:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146575:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146589:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599450.146636:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599450.146640:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599450.146677:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146700:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae1 expref: 7 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146718:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae1 expref: 6 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.146726:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:0.0:1787599450.146729:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599450.146733:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324600, rc 0) 00000100:00100000:0.0:1787599450.146849:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+6:11085:x1874433559002240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 412us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599450.146857:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00080000:1.0:1787599450.147006:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599450.153505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599450.155144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002368 00000100:00100000:0.0:1787599450.155175:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002368 00000100:00100000:0.0:1787599450.155250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1787599450.155261:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:11086:x1874433559002368:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599450.155292:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599450.155316:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbae8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155383:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155396:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155416:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155429:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155435:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155441:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155498:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155505:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.155511:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599450.155550:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599450.155553:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599450.165438:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165467:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165474:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165481:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165487:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599450.165493:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165501:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165521:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:0.0:1787599450.165525:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599450.165529:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165535:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165554:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165586:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165592:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165598:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599450.165601:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165606:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165614:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96b355403900) 00010000:00010000:0.0:1787599450.165616:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599450.165619:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165679:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae8 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165695:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae8 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.165702:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599450.165704:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599450.165713:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325400, rc 0) 00000100:00100000:0.0:1787599450.165836:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11086:x1874433559002368:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 10531us (12295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599450.165845:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1787599450.171675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599450.173471:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002496 00000100:00100000:0.0:1787599450.173490:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002496 00000100:00100000:2.0:1787599450.174498:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599450.174517:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11086:x1874433559002496:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787599450.174674:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11086:x1874433559002496:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 164us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599450.174683:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1787599450.185610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599450.187160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002752 00000100:00100000:0.0:1787599450.187177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002752 00000100:00100000:0.0:1787599450.187268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1787599450.187289:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11086:x1874433559002752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599450.187316:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599450.187350:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbaef expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187785:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187839:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187850:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187866:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187874:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.187881:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188015:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf602 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188024:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf602 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188030:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf602 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599450.188039:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787599450.188139:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188148:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188156:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188162:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599450.188166:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188174:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188186:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:0.0:1787599450.188189:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599450.188194:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188211:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf5f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188228:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188235:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188240:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188245:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599450.188248:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188254:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188263:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96b355403900) 00010000:00010000:0.0:1787599450.188265:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599450.188267:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf5fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.188768:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf5ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaef expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.189080:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf602 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaef expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599450.189099:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:0.0:1787599450.189101:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599450.189105:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324e00, rc 0) 00000100:00100000:0.0:1787599450.189175:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11086:x1874433559002752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1888us (3576us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787599450.189183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1787599450.197093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599450.204566:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559002880 00000100:00100000:2.0:1787599450.204582:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559002880 00000100:00100000:2.0:1787599450.204651:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1787599450.204661:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11086:x1874433559002880:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787599450.205016:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11086:x1874433559002880:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 355us (7932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599450.205025:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000040:00080000:1.0:1787599450.214497:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599450.224065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599450.224161:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003008 00000100:00100000:0.0:1787599450.224176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003008 00000100:00100000:0.0:1787599450.224256:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1787599450.224267:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:11086:x1874433559003008:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787599450.225134:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 812us 00000100:00080000:1.0:1787599450.225897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599450.247513:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:11086:x1874433559003008:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 23235us (23447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599450.247528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:0.0:1787599450.342600:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599450.662212:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599450.662237:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577973504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599450.662319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599450.662400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577973504 00000100:00100000:0.0:1787599450.662409:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577973504 00000100:00100000:0.0:1787599450.662469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787599450.662480:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577973504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599450.662511:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787599450.662557:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577973504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599450.662577:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787599450.662622:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577973504:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787599451.237586:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599451.371476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599452.104590:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.104632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.104670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.104690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.104711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.104739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003392 00000100:00100000:1.0:1787599452.104749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003392 00000100:00100000:1.0:1787599452.104833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003648 00000100:00100000:1.0:1787599452.104838:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003648 00000100:00100000:1.0:1787599452.104853:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003264 00000100:00100000:1.0:1787599452.104856:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003264 00000100:00100000:1.0:1787599452.104870:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003520 00000100:00100000:1.0:1787599452.104872:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003520 00000100:00100000:1.0:1787599452.104903:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:1.0:1787599452.104914:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559003392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599452.104987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559003392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.104995:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:1.0:1787599452.105013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:1.0:1787599452.105020:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559003648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599452.105044:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559003648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.105051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:1.0:1787599452.105061:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:1.0:1787599452.105067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2405:x1874433559003264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599452.105089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2405:x1874433559003264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.105095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:1.0:1787599452.105105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:1.0:1787599452.105112:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559003520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599452.105134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559003520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.105139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00080000:1.0:1787599452.105164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599452.105168:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599452.105694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003136 00000100:00100000:3.0:1787599452.105702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003136 00000100:00100000:3.0:1787599452.105749:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 379 00000100:00100000:3.0:1787599452.105758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559003136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599452.105831:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559003136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599452.105838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 379 00000100:00100000:3.0:1787599452.197416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577973632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599452.197688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599452.197829:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577973632 00000100:00100000:2.0:1787599452.197837:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577973632 00000100:00100000:2.0:1787599452.197881:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787599452.197890:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577973632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599452.197922:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599452.197972:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577973632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599452.197980:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787599452.198058:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577973632:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787599452.261705:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787599452.262847:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599452.389126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599452.389203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559003776 00000100:00100000:2.0:1787599452.389214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559003776 00000100:00100000:2.0:1787599452.389283:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1787599452.389294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11128:x1874433559003776:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599452.389319:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599452.389340:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbaf6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389407:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389428:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389438:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389448:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389452:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389463:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389500:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389504:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389509:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389512:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599452.389515:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389520:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389527:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:2.0:1787599452.389530:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599452.389533:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389538:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389553:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389557:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389565:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389568:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599452.389570:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389573:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96b342bf1800) 00010000:00010000:2.0:1787599452.389580:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599452.389582:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389585:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf61e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389609:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf610 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaf6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389615:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:2.0:1787599452.389617:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599452.389619:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaf6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.389625:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:2.0:1787599452.389674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11128:x1874433559003776:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 383us (558us total) trans 0 rc 301/301 00000100:00100000:2.0:1787599452.389690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1787599452.396506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1787599452.397007:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599452.397060:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004032 00000100:00100000:1.0:1787599452.397070:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004032 00000100:00100000:1.0:1787599452.397129:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1787599452.397140:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11128:x1874433559004032:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:1.0:1787599452.397195:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599452.397219:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf5ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae1 expref: 9 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397238:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b355403000) 00010000:00010000:1.0:1787599452.397260:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599452.397330:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397343:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397353:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397367:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397373:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.397378:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398448:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398489:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398499:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599452.398520:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074e2421f reply state 00000000894e950a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398533:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398542:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599452.398545:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599452.398550:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787599452.398556:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787599452.398564:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398570:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398576:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398582:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599452.398586:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398594:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398615:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242159100) 00010000:00010000:1.0:1787599452.398617:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599452.398621:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398627:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf625 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599452.398645:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074e2421f reply state 00000000894e950a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398652:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.398658:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96b242159a00) 00010000:00010000:1.0:1787599452.398660:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599452.398662:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787599452.398776:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+10:11128:x1874433559004032:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 1634us (2275us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787599452.398784:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1787599452.549156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599452.549338:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004160 00000100:00100000:3.0:1787599452.549349:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004160 00000100:00100000:3.0:1787599452.549411:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1787599452.549421:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+10:11137:x1874433559004160:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:3.0:1787599452.549461:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599452.549483:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf63a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbafd expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549550:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549562:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549572:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599452.549619:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787599452.549622:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599452.549667:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549693:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf63a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbafd expref: 12 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549709:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbafd expref: 11 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.549717:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:3.0:1787599452.549720:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599452.549724:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ca00, rc 0) 00000100:00100000:3.0:1787599452.550234:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+11:11137:x1874433559004160:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 810us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599452.550243:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1787599452.640618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.640848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004288 00000100:00100000:1.0:1787599452.640859:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004288 00000100:00100000:1.0:1787599452.641238:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1787599452.641263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+11:11143:x1874433559004288:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599452.641281:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599452.641304:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb04 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641396:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641410:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641432:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641444:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641452:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641459:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641532:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641541:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641549:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599452.641582:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787599452.641585:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599452.641627:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641662:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641669:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641677:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641682:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599452.641686:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641693:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641705:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:1.0:1787599452.641708:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599452.641714:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641720:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf64f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641735:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641741:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641747:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641759:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599452.641763:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641769:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641831:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96b242159a00) 00010000:00010000:1.0:1787599452.641835:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599452.641838:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641845:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf656 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641871:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb04 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641884:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb04 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.641891:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599452.641894:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599452.641896:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030200, rc 0) 00000100:00100000:1.0:1787599452.642278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+12:11143:x1874433559004288:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1028us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.642286:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1787599452.645551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.645690:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004544 00000100:00100000:1.0:1787599452.645710:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004544 00000100:00100000:1.0:1787599452.645821:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1787599452.645832:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+12:11143:x1874433559004544:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599452.645851:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599452.645871:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf664 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb0b expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646096:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646111:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646122:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646175:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646183:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646191:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599452.646600:0:10099:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787599452.646885:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646896:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.646918:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647016:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647023:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647030:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647036:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599452.647041:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647049:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647062:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599452.647065:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599452.647070:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647077:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf66b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599452.647091:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf34de05 reply state 00000000260efd07 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647102:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647115:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:1.0:1787599452.647118:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599452.647120:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599452.647153:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf664 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 15 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647167:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 14 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.647174:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:1.0:1787599452.647177:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599452.647179:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a200, rc 0) 00000100:00100000:1.0:1787599452.647322:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+15:11143:x1874433559004544:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1491us (1779us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787599452.647331:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:2.0:1787599452.650653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.650757:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004672 00000100:00100000:0.0:1787599452.650778:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004672 00000100:00100000:0.0:1787599452.650861:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599452.650870:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874433559004672:12345-192.168.202.1@tcp:8:bash.0 00010000:00080000:0.0:1787599452.650910:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:0.0:1787599452.650953:0:8433:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf687 00002000:00100000:0.0:1787599452.650965:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4ef2ef44-63df-45fd-9e68-c54398cec083/ffff96b347dce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787599452.650987:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787599452.651066:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787599452.651100:0:8433:0:(import.c:65:import_set_state_nolock()) ffff96b347dcd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599452.651162:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433559004672:12345-192.168.202.1@tcp:8:bash.0 Request processed in 291us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599452.651170:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1787599452.654268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.654450:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004800 00000100:00100000:0.0:1787599452.654461:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004800 00000100:00080000:1.0:1787599452.654514:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599452.654536:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599452.654544:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433559004800:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599452.654558:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599452.654578:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb12 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599452.654599:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599452.654631:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1787599452.654634:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599452.654642:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.654657:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.654667:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325600, rc 0) 00000100:00100000:0.0:1787599452.654722:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:0:x1874433559004800:12345-192.168.202.1@tcp:101:bash.0 Request processed in 179us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599452.654729:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1787599452.657606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.658045:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559004928 00000100:00100000:0.0:1787599452.658053:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559004928 00000100:00100000:0.0:1787599452.658102:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1787599452.658171:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11143:x1874433559004928:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599452.658188:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599452.658206:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb19 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.658238:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.658247:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599452.658262:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599452.658268:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.658320:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.658333:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.658348:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577973760:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599452.658493:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599452.664670:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577973760:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599452.664710:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.664733:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324400, rc 0) 00000100:00100000:0.0:1787599452.664838:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:11143:x1874433559004928:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6725us (7240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599452.664847:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1787599452.665244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.665310:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559005056 00000100:00100000:0.0:1787599452.665322:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559005056 00010000:00010000:0.0:1787599452.665357:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.665389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1787599452.665396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559005056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599452.665430:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599452.665448:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.665458:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.665475:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ea4ffb9/0x5d2988b0929cf68e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb12 expref: 8 pid: 8629 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.665486:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599452.665490:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599452.665496:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.665503:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.665528:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.665539:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874433577973888:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599452.665587:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599452.671410:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874433577973888:192.168.202.1@tcp:105: 00010000:00010000:0.0:1787599452.671445:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599452.671543:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559005056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6144us (6299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599452.671554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1787599452.672689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.672751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559005312 00000100:00100000:0.0:1787599452.672760:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559005312 00000100:00100000:0.0:1787599452.672836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1787599452.672847:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+15:11143:x1874433559005312:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:0.0:1787599452.673469:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11143:x1874433559005312:12345-192.168.202.1@tcp:35:bash.0 Request processed in 620us (782us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787599452.673478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1787599452.766655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599452.767450:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559005568 00000100:00100000:2.0:1787599452.767465:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559005568 00000100:00100000:3.0:1787599452.767684:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1787599452.767696:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11152:x1874433559005568:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599452.767725:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599452.767749:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf69c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb20 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599452.767908:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787599452.768023:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf69c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb20 expref: 18 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.768039:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:3.0:1787599452.768042:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599452.768047:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf69c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb20 expref: 18 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.768061:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d800, rc 0) 00000100:00100000:3.0:1787599452.768129:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11152:x1874433559005568:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 434us (1486us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787599452.768136:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1787599452.772013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.772107:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559005824 00000100:00100000:0.0:1787599452.772118:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559005824 00000100:00100000:0.0:1787599452.772180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1787599452.772189:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11152:x1874433559005824:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599452.772539:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11152:x1874433559005824:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 349us (534us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787599452.772548:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599452.884902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.886916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559005952 00000100:00100000:1.0:1787599452.886934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559005952 00000100:00100000:1.0:1787599452.887012:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1787599452.887025:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11159:x1874433559005952:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599452.887055:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599452.887076:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887145:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887177:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887187:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599452.887231:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787599452.887234:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599452.887266:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887291:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb27 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887309:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb27 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.887318:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599452.887320:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599452.887324:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599452.887459:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11159:x1874433559005952:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 436us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.887467:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599452.900721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.900828:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006208 00000100:00100000:1.0:1787599452.900843:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006208 00000100:00100000:1.0:1787599452.900909:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599452.900928:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11159:x1874433559006208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599452.900950:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599452.900987:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb2e expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.901094:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf6bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.901108:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf6bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.901132:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf6bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599452.901144:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787599452.901257:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb2e expref: 22 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.901278:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf6bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb2e expref: 21 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.901287:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:1.0:1787599452.901290:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599452.901293:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599452.901351:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+21:11159:x1874433559006208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 433us (641us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787599452.901357:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1787599452.907606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599452.907701:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006464 00000100:00100000:3.0:1787599452.907713:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006464 00000100:00100000:3.0:1787599452.907777:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1787599452.907787:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+21:11159:x1874433559006464:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599452.907838:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599452.907877:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf6cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb35 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.908106:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.908312:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.908324:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599452.908338:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787599452.909107:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf6cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb35 expref: 24 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.910684:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb35 expref: 23 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.910696:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:3.0:1787599452.910700:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599452.910704:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d800, rc 0) 00000100:00100000:3.0:1787599452.916721:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+23:11159:x1874433559006464:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 8923us (9113us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787599452.916736:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1787599452.917221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599452.919400:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006592 00000100:00100000:3.0:1787599452.919431:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006592 00000100:00100000:3.0:1787599452.919518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1787599452.919528:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+23:2404:x1874433559006592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599452.919564:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599452.919592:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf6bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb2e expref: 23 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.919613:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:3.0:1787599452.919618:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599452.919689:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2404:x1874433559006592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 162us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599452.919696:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1787599452.925402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599452.925545:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006720 00000100:00100000:3.0:1787599452.925556:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006720 00000100:00100000:3.0:1787599452.925623:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1787599452.925633:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559006720:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1787599452.925684:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.925703:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.925711:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599452.925715:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599452.925719:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.925756:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.925790:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 7 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599452.925828:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1874433577974016:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599452.925918:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b35ac31cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599452.929283:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1874433577974016:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599452.929326:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.934994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599452.935868:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006848 00000100:00100000:2.0:1787599452.935883:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006848 00002000:00100000:2.0:1787599452.935947:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff96b351768000 x1874433559006848/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:308/0 lens 504/0 e 0 to 0 dl 1787599463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599452.935959:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b351768000 with x1874433559006848 ext(0->12) 00010000:00010000:2.0:1787599452.935971:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 8 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.935990:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 8 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599452.935999:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b351768000 00000100:00100000:2.0:1787599452.936042:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1787599452.936053:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559006848:12345-192.168.202.1@tcp:4:lfs.0 00000001:00100000:0.0:1787599452.945510:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000100:00100000:2.0:1787599452.946383:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559006848:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 10325us (11393us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787599452.946396:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:2.0:1787599452.946419:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff96b351768000 x1874433559006848/t4294967300(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:308/0 lens 504/448 e 0 to 0 dl 1787599463 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599452.946430:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b351768000 with x1874433559006848 ext(0->12) 00010000:00010000:2.0:1787599452.946442:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.946461:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599452.946469:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b351768000 00000100:00100000:2.0:1787599452.951351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.951467:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559006976 00000100:00100000:0.0:1787599452.951477:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559006976 00010000:00010000:0.0:1787599452.951518:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.951572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1787599452.951582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559006976:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599452.951613:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787599452.951633:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787599452.951635:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787599452 00002000:00010000:0.0:1787599452.951637:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787599453 00002000:00010000:0.0:1787599452.951640:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787599452 00002000:00010000:0.0:1787599452.951642:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787599452.951648:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.951662:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.951686:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a052f3f/0x5d2988b0929cf695 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb19 expref: 9 pid: 8433 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.951704:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599452.951708:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599452.951713:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.951723:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.951761:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599452.951861:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559006976:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 280us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599452.951870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00010000:00010000:2.0:1787599452.953717:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953737:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953782:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953821:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953850:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953857:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599452.953861:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953871:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953893:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.953900:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000426b229d/0x5d2988b0929cf6e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599452.954056:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559006720:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 28420us (28673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599452.954065:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1787599452.958502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599452.958559:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559007232 00000100:00100000:0.0:1787599452.958570:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559007232 00000100:00100000:0.0:1787599452.958632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1787599452.958642:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11159:x1874433559007232:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:0.0:1787599452.958719:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb35 expref: 22 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599452.959293:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787599452.959345:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787599452.959624:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787599452.959657:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.959721:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 26 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.959729:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.959758:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 26 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599452.961140:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 26 pid: 10099 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599452.961158:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874433577974144:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599452.961330:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599452.967851:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874433577974144:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599452.967881:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599452.974735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.975203:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559007360 00000100:00100000:1.0:1787599452.975218:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559007360 00010000:00010000:1.0:1787599452.975272:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 27 pid: 10099 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599452.975345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599452.975356:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+27:2404:x1874433559007360:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599452.975372:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599452.975380:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 27 pid: 10099 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975394:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 27 pid: 10099 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975418:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb0b expref: 27 pid: 10099 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975438:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:1.0:1787599452.975444:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975453:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975460:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.975497:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599452.975563:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+26:2404:x1874433559007360:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 208us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.975570:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00010000:00010000:2.0:1787599452.975644:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599452.975652:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599452.975836:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787599452.975959:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787599452.976070:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577974272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787599452.976124:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599452.976152:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599452.976372:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577974272 00000100:00100000:1.0:1787599452.976387:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577974272 00000100:00100000:1.0:1787599452.976447:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1787599452.976456:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599452.976457:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874433577974272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599452.976555:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874433577974272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.976563:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787599452.976806:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577974272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787599452.977260:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787599452.977334:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577974400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787599452.977379:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599452.977418:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599452.977572:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577974400 00000100:00100000:1.0:1787599452.977578:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577974400 00000100:00100000:1.0:1787599452.977616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787599452.977626:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874433577974400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599452.977753:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1874433577974400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (373us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787599452.977759:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787599452.978233:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577974400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787599452.978299:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787599452.978341:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978354:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978362:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978384:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599452.978388:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978396:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978423:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:3.0:1787599452.978427:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787599452.978433:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599452.978440:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf6e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599452.978550:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787599452.978616:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787599452.978627:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399597834056ns, next at 400597832097ns, rc = 0 00000001:00080000:3.0:1787599452.978954:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1787599452.978987:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159500) 00010000:00010000:3.0:1787599452.978990:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599452.978998:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf6d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb35 expref: 30 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599452.979311:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+29:11159:x1874433559007232:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 20473us (20623us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787599452.979333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000020:00080000:3.0:1787599452.979338:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787599452.986999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.987119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559007488 00000100:00100000:1.0:1787599452.987132:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559007488 00000100:00100000:1.0:1787599452.987196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599452.987208:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+29:11159:x1874433559007488:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599452.987235:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599452.987268:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf6f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb3c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.987330:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb3c expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.987346:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb3c expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599452.987386:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599452.987389:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599452.987393:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a200, rc 0) 00000100:00100000:1.0:1787599452.987455:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11159:x1874433559007488:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 249us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599452.987462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1787599452.998563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599452.999105:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559007744 00000100:00100000:1.0:1787599452.999187:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559007744 00000100:00100000:1.0:1787599452.999312:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599452.999324:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ed1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11159:x1874433559007744:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599452.999578:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ed1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+31:11159:x1874433559007744:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 254us (1023us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787599452.999586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1787599453.123123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.123236:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559008000 00000100:00100000:1.0:1787599453.123260:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559008000 00000100:00100000:1.0:1787599453.123346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1787599453.123360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+31:11169:x1874433559008000:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599453.123395:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599453.123428:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb43 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599453.123555:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787599453.123667:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb43 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.123695:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:1.0:1787599453.123698:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599453.123704:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf6f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb43 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.123721:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152be00, rc 0) 00000100:00100000:1.0:1787599453.123880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11169:x1874433559008000:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 520us (765us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1787599453.123887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1787599453.128408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599453.128539:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559008128 00000100:00100000:3.0:1787599453.128550:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559008128 00000100:00100000:3.0:1787599453.128650:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1787599453.128661:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11169:x1874433559008128:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1787599453.128744:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128760:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128771:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128783:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128827:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128836:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128911:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128933:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.128942:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599453.128989:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129015:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129022:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129029:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129035:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599453.129039:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129045:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129057:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599453.129060:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599453.129064:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129070:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf705 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129081:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129086:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129091:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129104:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599453.129107:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129112:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129121:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:3.0:1787599453.129123:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599453.129126:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129131:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf70c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129140:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129146:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129151:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129156:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599453.129159:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129165:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129186:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599453.129188:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599453.129191:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.129197:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599453.129293:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11169:x1874433559008128:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 632us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599453.129300:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599453.140598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599453.140684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559008384 00000100:00100000:3.0:1787599453.140695:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559008384 00000100:00100000:3.0:1787599453.140759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1787599453.140780:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11169:x1874433559008384:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599453.141016:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+33:11169:x1874433559008384:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 238us (427us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787599453.141023:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1787599453.187692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.187853:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559008640 00000100:00100000:1.0:1787599453.187864:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559008640 00000100:00100000:1.0:1787599453.187933:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1787599453.187945:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+33:11172:x1874433559008640:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599453.187970:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599453.187991:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf71a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb4a expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188068:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188082:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188094:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188105:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188128:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188135:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188265:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188274:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188281:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599453.188291:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787599453.188367:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188374:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188380:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188385:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599453.188390:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188398:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188421:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599453.188424:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599453.188427:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188433:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf721 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188446:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188451:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188457:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188461:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599453.188464:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188470:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188477:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:1.0:1787599453.188479:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599453.188481:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188487:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf728 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188533:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf71a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 36 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188548:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 35 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.188555:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599453.188557:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599453.188559:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:1.0:1787599453.188630:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11172:x1874433559008640:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 688us (947us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787599453.188637:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1787599453.193229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.193355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559008768 00000100:00100000:1.0:1787599453.193366:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559008768 00000100:00100000:1.0:1787599453.193551:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1787599453.193566:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11172:x1874433559008768:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1787599453.193657:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193675:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193685:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193719:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193743:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193750:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193756:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599453.193761:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193768:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193780:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599453.193783:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599453.193788:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.193816:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf73d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599453.193892:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11172:x1874433559008768:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 330us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599453.193900:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1787599453.196069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599453.196176:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559009024 00000100:00100000:0.0:1787599453.196186:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559009024 00000100:00100000:0.0:1787599453.196264:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1787599453.196275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11172:x1874433559009024:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599453.196503:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+36:11172:x1874433559009024:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 230us (443us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787599453.196511:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00010000:00010000:0.0:1787599453.413012:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599453.514972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599453.515232:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559009280 00000100:00100000:0.0:1787599453.515254:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559009280 00000100:00100000:0.0:1787599453.515374:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1787599453.515386:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+36:11203:x1874433559009280:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1787599453.515422:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599453.515445:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf744 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb51 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.515553:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf74b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.515565:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.515573:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599453.515582:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787599453.515676:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf744 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb51 expref: 39 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.515703:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf74b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb51 expref: 38 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.515709:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:0.0:1787599453.515711:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599453.515713:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325c00, rc 0) 00000100:00100000:0.0:1787599453.515775:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11203:x1874433559009280:12345-192.168.202.1@tcp:101:cat.0 Request processed in 391us (813us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787599453.515782:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1787599453.519713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.520564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559009536 00000100:00100000:1.0:1787599453.520577:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559009536 00000100:00100000:1.0:1787599453.520643:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1787599453.520655:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11203:x1874433559009536:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1787599453.521230:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+39:11203:x1874433559009536:12345-192.168.202.1@tcp:35:cat.0 Request processed in 574us (1524us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787599453.521272:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599453.524607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.524933:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559009664 00000100:00100000:1.0:1787599453.524943:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559009664 00000100:00100000:1.0:1787599453.525018:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599453.525029:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+39:2403:x1874433559009664:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599453.525044:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599453.525069:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf74b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb51 expref: 39 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.525088:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599453.525092:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599453.525161:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+38:2403:x1874433559009664:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 134us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599453.525169:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1787599453.596892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599453.597023:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559009920 00000100:00100000:3.0:1787599453.597035:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559009920 00000100:00100000:3.0:1787599453.597096:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599453.597107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11209:x1874433559009920:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1787599453.597134:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599453.597153:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787599453.597182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf6b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb27 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597204:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599453.597209:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599453.597225:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf759 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb58 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597372:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597387:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 38 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597396:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597443:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 38 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.597455:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 38 pid: 10099 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599453.597470:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577974528:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599453.597578:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599453.601885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599453.602005:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010048 00000100:00100000:2.0:1787599453.602015:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010048 00010000:00010000:2.0:1787599453.602057:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 39 pid: 10099 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599453.602099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1787599453.602109:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+39:2404:x1874433559010048:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599453.602123:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599453.602131:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 39 pid: 10099 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599453.602144:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 39 pid: 10099 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599453.602184:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599453.602190:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599453.602200:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599453.602206:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599453.602224:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599453.602297:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+39:2404:x1874433559010048:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 188us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599453.602305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00010000:00010000:1.0:1787599453.603087:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf72f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb4a expref: 38 pid: 10099 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599453.603109:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577974528:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599453.603145:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.603156:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.603161:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599453.603197:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787599453.604632:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf759 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.604658:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.604667:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599453.604670:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599453.604673:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200da00, rc 0) 00000100:00100000:1.0:1787599453.604737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11209:x1874433559009920:12345-192.168.202.1@tcp:101:dd.0 Request processed in 7630us (7853us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787599453.604746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599453.608837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.609016:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010176 00000100:00100000:1.0:1787599453.609027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010176 00000100:00100000:1.0:1787599453.609096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1787599453.609107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11209:x1874433559010176:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1787599453.609131:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599453.609154:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf76e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb5f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609187:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609201:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609233:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609392:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf76e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609423:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599453.609432:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599453.609435:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599453.609439:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031400, rc 0) 00000100:00100000:1.0:1787599453.609512:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+39:11209:x1874433559010176:12345-192.168.202.1@tcp:101:dd.0 Request processed in 407us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599453.609520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1787599453.613502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599453.613970:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010432 00000100:00100000:3.0:1787599453.614001:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010432 00000100:00100000:3.0:1787599453.614070:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1787599453.614081:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+39:11209:x1874433559010432:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1787599453.614554:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.614573:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.614583:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599453.614631:0:13004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787599453.614658:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000887ab8d4 reply state 000000002a075f6d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.614671:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599453.614678:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599453.614681:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599453.614685:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599453.615087:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+42:11209:x1874433559010432:12345-192.168.202.1@tcp:36:dd.0 Request processed in 1005us (1591us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787599453.615095:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000020:00080000:3.0:1787599453.615100:0:13004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787599453.978954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599453.982569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010560 00000100:00100000:1.0:1787599453.982586:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010560 00000100:00100000:0.0:1787599453.982940:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1787599453.982955:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+42:11223:x1874433559010560:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1787599453.982979:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599453.982999:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb66 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983062:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983076:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983086:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983096:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983121:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983128:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983197:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983208:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983223:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983272:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599453.983286:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 43 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599453.983299:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577974656:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599453.983574:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599453.995889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599453.995982:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577974656:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599453.996010:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599453.996096:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010816 00000100:00100000:1.0:1787599453.996103:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010816 00000100:00100000:1.0:1787599453.996180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1787599453.996189:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+44:6174:x1874433559010816:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599454.000455:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+45:6174:x1874433559010816:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 4252us (4560us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787599454.000471:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1787599454.003474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599454.003961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559010944 00000100:00100000:2.0:1787599454.003972:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559010944 00010000:00010000:2.0:1787599454.004032:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 45 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599454.004078:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599454.004088:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+45:2403:x1874433559010944:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599454.004103:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599454.004110:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 45 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004123:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 45 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004158:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cf760 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb58 expref: 45 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004174:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599454.004178:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004187:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004194:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004220:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599454.004282:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+44:2403:x1874433559010944:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 195us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.004290:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00010000:00010000:2.0:1787599454.004331:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004339:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599454.004387:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787599454.004391:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599454.004441:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004470:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004476:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.004483:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009065:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599454.009074:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009087:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009107:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599454.009110:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599454.009114:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf78a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009139:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009146:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009153:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009176:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599454.009179:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009184:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009193:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:2.0:1787599454.009196:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599454.009199:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009205:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf791 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009277:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb66 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009293:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb66 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.009300:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599454.009303:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599454.009306:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325600, rc 0) 00000100:00100000:2.0:1787599454.009369:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:11223:x1874433559010560:12345-192.168.202.1@tcp:101:stat.0 Request processed in 26417us (31697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.009378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00080000:3.0:1787599454.010072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599454.112711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.115075:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559011200 00000100:00100000:1.0:1787599454.115088:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559011200 00000100:00100000:1.0:1787599454.115154:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1787599454.115181:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+43:11229:x1874433559011200:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:1.0:1787599454.115254:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599454.115282:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf798 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb66 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.115304:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599454.115309:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599454.115492:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.115504:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.115511:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599454.115546:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1787599454.115561:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000484f577b reply state 00000000b8c723fd transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.115569:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.115573:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599454.115575:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599454.115577:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599454.115737:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+45:11229:x1874433559011200:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 558us (3035us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787599454.115743:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000020:00080000:1.0:1787599454.115747:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787599454.245008:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599454.245032:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577974784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599454.245106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599454.245263:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577974784 00000100:00100000:3.0:1787599454.245273:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577974784 00000100:00100000:3.0:1787599454.245352:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599454.245362:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577974784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599454.245390:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599454.245437:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577974784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.245445:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787599454.245524:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599454.245561:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577974784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599454.245905:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577975040:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.245936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.245955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577975552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.245973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.245993:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577976064:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599454.246041:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577975168:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246064:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577975680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246118:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577976192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246163:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976192 00000100:00100000:1.0:1787599454.246167:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976192 00000100:00100000:1.0:1787599454.246203:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599454.246211:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577976192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246263:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577976192:12345-0@lo:400:kworker.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.246283:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599454.246313:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975168 00000100:00100000:1.0:1787599454.246665:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975168 00000100:00100000:1.0:1787599454.246698:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787599454.246705:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577975168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246741:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577975168:12345-0@lo:400:kworker.0 Request processed in 37us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.246747:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787599454.246764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599454.246848:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577975296:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246867:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577975168:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.246880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577976192:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.246903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577975808:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975040 00000100:00100000:1.0:1787599454.246913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975040 00000100:00100000:3.0:1787599454.246924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246932:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975552 00000100:00100000:1.0:1787599454.246935:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975552 00000100:00100000:3.0:1787599454.246949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577976320:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246952:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976064 00000100:00100000:1.0:1787599454.246954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976064 00000100:00100000:1.0:1787599454.246965:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975680 00000100:00100000:1.0:1787599454.246968:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975680 00000100:00100000:3.0:1787599454.246969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.246978:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975296 00000100:00100000:1.0:1787599454.246981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975296 00000100:00100000:3.0:1787599454.246985:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787599454.246991:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577974912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.246993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787599454.246998:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577975040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.247029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577975040:12345-0@lo:400:kworker.0 Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.247035:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787599454.247036:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577975424:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.247046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787599454.247052:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577975552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599454.247070:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577975936:0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.247076:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577975552:12345-0@lo:400:kworker.0 Request processed in 25us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599454.247090:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787599454.247099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975936 00000100:00100000:1.0:1787599454.247103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975936 00000100:00100000:3.0:1787599454.247109:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975808 00000100:00100000:3.0:1787599454.247112:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975808 00000100:00100000:1.0:1787599454.247117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787599454.247122:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577976064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247134:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976320 00000100:00100000:3.0:1787599454.247136:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976320 00000100:00100000:3.0:1787599454.247151:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599454.247151:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577976064:12345-0@lo:400:kworker.0 Request processed in 28us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247157:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577975808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.247157:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787599454.247167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787599454.247172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577975680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247189:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577975808:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247200:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599454.247207:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577975680:12345-0@lo:400:kworker.0 Request processed in 35us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247212:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599454.247213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787599454.247217:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577976320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599454.247222:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787599454.247226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577975296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247259:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577976320:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.247262:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577975296:12345-0@lo:400:kworker.0 Request processed in 36us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247265:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599454.247267:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787599454.247293:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247302:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577975808:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577976320:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247335:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787599454.247342:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577975936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247376:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577975936:12345-0@lo:400:kworker.0 Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247382:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787599454.247407:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577975936:0@lo:400:kworker.0 00000100:00080000:3.0:1787599454.247444:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599454.247447:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599454.247449:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599454.247451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599454.247467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577974912 00000100:00100000:3.0:1787599454.247470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577974912 00000100:00100000:3.0:1787599454.247511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787599454.247518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577974912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577974912:12345-0@lo:400:kworker.0 Request processed in 33us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247562:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787599454.247594:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577974912:0@lo:400:kworker.0 00000100:00100000:3.0:1787599454.247602:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599454.247609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577976448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599454.247633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787599454.247685:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f85b100 x1874433577975680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599454.247696:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577975680:0@lo:400:kworker.0 00000100:00100000:2.0:1787599454.247709:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976448 00000100:00100000:3.0:1787599454.247710:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577975040:0@lo:400:kworker.0 00000100:00100000:2.0:1787599454.247713:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976448 00000100:00100000:3.0:1787599454.247720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577975552:0@lo:400:kworker.0 00010000:00080000:3.0:1787599454.247730:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f859880 x1874433577976064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599454.247738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577976064:0@lo:400:kworker.0 00000100:00100000:2.0:1787599454.247740:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787599454.247746:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577976448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599454.247760:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599454.247833:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577976448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.247840:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787599454.247855:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577976448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599454.247974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577975424 00000100:00100000:0.0:1787599454.247985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577975424 00000100:00100000:0.0:1787599454.248022:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787599454.248030:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577975424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599454.248080:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577975424:12345-0@lo:400:kworker.0 Request processed in 51us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599454.248086:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787599454.254890:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577975424:0@lo:400:kworker.0 00000100:00100000:0.0:1787599454.297992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599454.298085:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559011328 00000100:00100000:3.0:1787599454.298095:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559011328 00000100:00100000:3.0:1787599454.298154:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1787599454.298164:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+45:11243:x1874433559011328:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:3.0:1787599454.298191:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599454.298225:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb6d expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298495:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298512:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298524:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298534:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298542:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298548:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298619:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298628:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298634:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599454.298672:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787599454.298676:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599454.298698:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298720:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298728:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298734:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298741:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298746:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599454.298751:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298758:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298769:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599454.298772:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599454.298776:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298783:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf7ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298889:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298895:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298907:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298913:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599454.298916:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298921:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298930:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:3.0:1787599454.298932:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599454.298935:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298941:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf7b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298965:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 47 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298976:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 46 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.298983:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599454.298985:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599454.298988:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d600, rc 0) 00000100:00100000:3.0:1787599454.299094:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+46:11243:x1874433559011328:12345-192.168.202.1@tcp:101:stat.0 Request processed in 930us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599454.299109:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:0.0:1787599454.436970:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599454.448284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.448620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559011584 00000100:00100000:1.0:1787599454.448629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559011584 00000100:00100000:1.0:1787599454.448685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1787599454.448696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+46:11253:x1874433559011584:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599454.448717:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599454.448737:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf7c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb74 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599454.448901:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787599454.449003:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf7c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb74 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.449018:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:1.0:1787599454.449021:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599454.449027:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb74 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.449042:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:1.0:1787599454.449166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+47:11253:x1874433559011584:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 470us (892us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787599454.449173:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1787599454.456982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599454.457139:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559011840 00000100:00100000:0.0:1787599454.457150:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559011840 00000100:00100000:0.0:1787599454.457277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1787599454.457289:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+47:11253:x1874433559011840:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599454.458060:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+48:11253:x1874433559011840:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 768us (1082us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787599454.458069:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1787599454.529139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.529418:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012096 00000100:00100000:1.0:1787599454.529430:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012096 00000100:00100000:1.0:1787599454.529497:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1787599454.529510:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+48:11259:x1874433559012096:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599454.529533:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599454.529556:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf7d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb7b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.534992:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.535024:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 49 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.535057:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.535101:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 49 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.535120:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 49 pid: 13004 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599454.535137:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577976576:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599454.535316:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599454.539050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.540021:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577976576:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599454.540052:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599454.544676:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012224 00000100:00100000:0.0:1787599454.544695:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012224 00010000:00010000:0.0:1787599454.544760:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 50 pid: 13004 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599454.544858:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1787599454.544871:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+50:2403:x1874433559012224:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599454.544889:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599454.544898:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 50 pid: 13004 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.544933:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 50 pid: 13004 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.544958:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cf7bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb6d expref: 50 pid: 13004 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.544979:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:0.0:1787599454.544986:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.544997:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.545005:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.545039:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599454.545117:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+49:2403:x1874433559012224:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 248us (6078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599454.545124:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:1.0:1787599454.545283:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.545293:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599454.545314:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787599454.545485:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929cf7d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.545506:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.545528:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599454.545531:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599454.545534:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599454.545566:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+49:11259:x1874433559012096:12345-192.168.202.1@tcp:101:bash.0 Request processed in 16059us (16437us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787599454.545573:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1787599454.554320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599454.554445:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012480 00000100:00100000:3.0:1787599454.554456:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012480 00000100:00100000:3.0:1787599454.554561:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1787599454.554574:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+49:11259:x1874433559012480:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1787599454.555013:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.555032:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.555044:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599454.555090:0:13004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787599454.555115:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b42894e3 reply state 00000000a8a84d65 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.555127:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599454.555134:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599454.555137:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599454.555140:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599454.555389:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+52:11259:x1874433559012480:12345-192.168.202.1@tcp:36:bash.0 Request processed in 816us (1077us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787599454.555397:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000020:00080000:3.0:1787599454.555421:0:13004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787599454.560994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599454.562416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012608 00000100:00100000:2.0:1787599454.562436:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012608 00000100:00100000:2.0:1787599454.562525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1787599454.562537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+52:11259:x1874433559012608:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599454.562566:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599454.562592:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf7ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb82 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.563003:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.563022:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.563032:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.563073:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.563112:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 53 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599454.563132:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577976704:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599454.563410:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34388b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599454.566052:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577976704:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599454.566086:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599454.567683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.568066:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012736 00000100:00100000:1.0:1787599454.568077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012736 00010000:00010000:1.0:1787599454.568121:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 54 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599454.568163:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1787599454.568174:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+54:2403:x1874433559012736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599454.568189:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599454.568196:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 54 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568208:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 54 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568239:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb7b expref: 54 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568257:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599454.568261:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568287:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568295:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.568392:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599454.568506:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+53:2403:x1874433559012736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 333us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.568515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00010000:00010000:2.0:1787599454.568564:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.568574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599454.568640:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787599454.568645:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599454.568669:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.568697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf7ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb82 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.568713:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb82 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.568720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599454.568728:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599454.568731:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599454.568767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+52:11259:x1874433559012608:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6233us (7827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.568774:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1787599454.578070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.578271:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559012992 00000100:00100000:1.0:1787599454.578281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559012992 00000100:00100000:1.0:1787599454.578417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1787599454.578430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ed0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+52:11259:x1874433559012992:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1787599454.578648:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ed0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11259:x1874433559012992:12345-192.168.202.1@tcp:35:bash.0 Request processed in 220us (586us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787599454.578656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1787599454.715171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.715551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559013248 00000100:00100000:1.0:1787599454.715562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559013248 00000100:00100000:1.0:1787599454.715631:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1787599454.715642:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11269:x1874433559013248:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599454.715670:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599454.715694:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb89 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599454.716011:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787599454.716116:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb89 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.716145:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:1.0:1787599454.716148:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599454.716154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf7fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb89 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.716168:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599454.717569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11269:x1874433559013248:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1919us (2397us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1787599454.717581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1787599454.721891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599454.722142:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559013376 00000100:00100000:0.0:1787599454.722155:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559013376 00000100:00100000:0.0:1787599454.722221:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1787599454.722241:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11269:x1874433559013376:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1787599454.722330:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722363:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722375:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722389:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722396:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722403:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722484:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722494:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722500:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599454.722552:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722565:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722571:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722589:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722595:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599454.722600:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722609:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722623:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:0.0:1787599454.722626:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599454.722631:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722637:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722651:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722657:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722663:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722668:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599454.722671:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722685:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722693:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:0.0:1787599454.722695:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599454.722698:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722704:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325000/0x5d2988b0929cf80f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722713:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722720:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722726:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722730:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599454.722733:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722739:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722745:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:0.0:1787599454.722747:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599454.722749:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599454.722762:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cf816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599454.722866:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11269:x1874433559013376:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 635us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599454.722874:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1787599454.734592:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599454.734993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559013632 00000100:00100000:2.0:1787599454.735005:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559013632 00000100:00100000:2.0:1787599454.735068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599454.735080:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11269:x1874433559013632:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1787599454.735516:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+55:11269:x1874433559013632:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 437us (932us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787599454.735524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1787599454.757394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599454.757422:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577976832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599454.757498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787599454.760451:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401379656343ns, next at 402379653759ns, rc = 0 00000100:00100000:0.0:1787599454.760542:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577976960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599454.760606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599454.760984:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976832 00000100:00100000:2.0:1787599454.760993:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976832 00000100:00100000:2.0:1787599454.761041:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577976960 00000100:00100000:2.0:1787599454.761045:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577976960 00000100:00100000:2.0:1787599454.761062:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787599454.761071:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577976832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599454.761101:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787599454.761157:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577976832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.761164:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787599454.761182:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787599454.761188:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577976960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599454.761198:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787599454.761244:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577976960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.761262:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787599454.761530:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577976960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599454.761551:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577976832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599454.851741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599454.852017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559013888 00000100:00100000:2.0:1787599454.852029:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559013888 00000100:00100000:2.0:1787599454.852089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1787599454.852101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+55:11272:x1874433559013888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599454.852127:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599454.852147:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf81d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb90 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852245:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852260:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852272:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852283:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852290:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852306:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852445:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf832 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852462:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599454.852472:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787599454.852544:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852551:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852557:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852563:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599454.852568:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852575:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852587:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599454.852591:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599454.852595:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852612:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cf824 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852626:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852632:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852638:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852656:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599454.852659:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852666:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852674:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:2.0:1787599454.852676:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599454.852679:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852684:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf82b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852719:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf81d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb90 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852733:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf832 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb90 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.852757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599454.852760:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599454.852763:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758600, rc 0) 00000100:00100000:2.0:1787599454.852880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11272:x1874433559013888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 781us (1148us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787599454.852889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1787599454.855729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599454.855778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599454.856147:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559014016 00000100:00100000:1.0:1787599454.856159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559014016 00000100:00100000:1.0:1787599454.856225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1787599454.856247:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11272:x1874433559014016:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1787599454.856483:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856501:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856513:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856549:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856556:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856577:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856583:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599454.856587:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856594:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856607:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599454.856610:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599454.856615:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599454.856621:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599454.857731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559014144 00000100:00100000:2.0:1787599454.857755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559014144 00000100:00100000:2.0:1787599454.857851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599454.857861:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+58:2405:x1874433559014144:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599454.857874:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599454.857896:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf832 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb90 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599454.857912:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599454.857917:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599454.857976:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+57:2405:x1874433559014144:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 117us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599454.857983:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1787599454.859001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+56:11272:x1874433559014016:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 2746us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599454.859012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1787599454.867694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599454.868102:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559014400 00000100:00100000:2.0:1787599454.868114:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559014400 00000100:00100000:2.0:1787599454.868162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599454.868173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+56:11272:x1874433559014400:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1787599454.868634:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11272:x1874433559014400:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 459us (947us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787599454.868670:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599455.119957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.120042:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559014656 00000100:00100000:3.0:1787599455.120052:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559014656 00000100:00100000:3.0:1787599455.120113:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1787599455.120123:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11290:x1874433559014656:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1787599455.120147:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599455.120168:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb97 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.120311:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf84e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.120325:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.120335:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599455.120347:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787599455.120614:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb97 expref: 60 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.120633:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf84e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb97 expref: 59 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.120654:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599455.120658:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787599455.120662:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ce00, rc 0) 00000100:00100000:3.0:1787599455.120728:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11290:x1874433559014656:12345-192.168.202.1@tcp:101:cat.0 Request processed in 606us (781us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787599455.120736:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1787599455.163528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.167466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559014784 00000100:00100000:1.0:1787599455.167479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559014784 00000100:00100000:1.0:1787599455.167536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1787599455.167544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11291:x1874433559014784:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599455.167567:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599455.167585:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf85c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbb9e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167661:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167671:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167680:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599455.167716:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787599455.167718:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599455.167736:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167758:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf85c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb9e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167779:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb9e expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.167788:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599455.167842:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599455.167845:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599455.167900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11291:x1874433559014784:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 357us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599455.167905:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1787599455.172548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.172626:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015168 00000100:00100000:2.0:1787599455.172635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015168 00000100:00100000:2.0:1787599455.172684:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1787599455.172691:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11291:x1874433559015168:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1787599455.173006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11291:x1874433559015168:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 314us (466us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787599455.173014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1787599455.183245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.183412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015296 00000100:00100000:0.0:1787599455.183424:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015296 00000100:00100000:0.0:1787599455.183506:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1787599455.183519:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11291:x1874433559015296:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1787599455.183536:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787599455.183561:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf7f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb82 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.183584:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cf84e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb97 expref: 60 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.183617:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf6f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb3c expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.183628:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:0.0:1787599455.183633:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599455.183693:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11291:x1874433559015296:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 177us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.183701:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1787599455.185983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.186392:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015424 00000100:00100000:0.0:1787599455.186406:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015424 00000100:00100000:0.0:1787599455.186483:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1787599455.186495:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11291:x1874433559015424:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1787599455.186648:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.186667:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.186678:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599455.186936:0:13004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599455.187075:0:13004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787599455.187165:0:13004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787599455.187273:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11291:x1874433559015424:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 778us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.187282:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1787599455.218978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.219082:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015552 00000100:00100000:1.0:1787599455.219093:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015552 00000100:00100000:1.0:1787599455.219175:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1787599455.219186:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11293:x1874433559015552:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599455.219213:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599455.219243:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf871 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbba5 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219314:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219327:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219338:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219350:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219358:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219364:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219453:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219463:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219470:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599455.219526:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787599455.219530:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599455.219550:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219563:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219571:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219576:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219582:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219588:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599455.219592:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219599:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219611:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599455.219615:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599455.219619:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219626:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219652:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219657:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219663:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219668:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599455.219671:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219676:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219683:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:1.0:1787599455.219685:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599455.219688:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219693:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf87f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219722:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf871 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 60 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219737:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 59 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.219756:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599455.219758:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599455.219761:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152be00, rc 0) 00000100:00100000:1.0:1787599455.219888:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11293:x1874433559015552:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 703us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599455.219896:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000040:00080000:0.0:1787599455.333361:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599455.333372:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599455.333420:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787599455.333431:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599455.333574:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577977088:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599455.333859:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599455.343485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.344386:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577977088:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599455.344730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015680 00000100:00100000:2.0:1787599455.344738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015680 00000100:00100000:2.0:1787599455.344832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1787599455.344842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11304:x1874433559015680:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787599455.344873:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787599455.344979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11304:x1874433559015680:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 139us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.344986:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1787599455.347515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.347632:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559015808 00000100:00100000:0.0:1787599455.347641:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559015808 00000100:00100000:0.0:1787599455.347691:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1787599455.347700:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11304:x1874433559015808:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787599455.347764:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347779:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347807:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347854:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347862:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347868:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347891:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347911:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347918:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599455.347961:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787599455.347965:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599455.347977:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347988:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.347993:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348000:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348006:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599455.348010:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348017:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348028:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:0.0:1787599455.348031:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599455.348035:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348050:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cf88d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348065:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348070:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348076:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348081:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599455.348084:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348089:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348097:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff96b35acbbb00) 00010000:00010000:0.0:1787599455.348099:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599455.348102:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348107:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf894 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348120:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348125:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348136:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348140:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599455.348143:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348259:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348269:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:0.0:1787599455.348271:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599455.348274:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.348280:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.348357:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11304:x1874433559015808:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 657us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.348364:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000001:00080000:1.0:1787599455.349341:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:1.0:1787599455.349361:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787599455.349426:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787599455.349435:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b3706b2600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787599455.349439:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b377bed500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b35ac31cc0 00000020:00080000:1.0:1787599455.349443:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b377bed100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b377afa000 00000100:00100000:3.0:1787599455.349712:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599455.349729:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577977216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787599455.349811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599455.349858:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577977216 00000100:00100000:3.0:1787599455.349864:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577977216 00000100:00100000:3.0:1787599455.349904:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599455.349913:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577977216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787599455.349936:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1787599455.349963:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c9a5c, atime: 0x6a8c9a5d, ctime: 0x6a8c9a5c, blocks: 0x8 00010000:00010000:3.0:1787599455.349970:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.349986:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1787599455.349990:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599455.350008:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350024:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350034:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350041:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350057:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599455.350339:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577977216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 425us (527us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787599455.350347:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787599455.350372:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599455.350378:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350387:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc0b4e230) 00000020:00080000:0.0:1787599455.350501:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787599455.350641:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:0.0:1787599455.350694:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2434ea680/2, rc 0, transno 4294967302 00000100:00100000:0.0:1787599455.350700:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577977216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787599455.350821:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350833:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350863:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350870:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cf8a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.350891:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599455.350893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599455.350895:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599455.353365:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353382:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353390:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353416:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353421:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353428:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353444:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96b242159a00) 00010000:00010000:2.0:1787599455.353447:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353452:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353459:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929cf62c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353485:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353492:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353498:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353502:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353505:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353510:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353528:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599455.353530:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353533:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353538:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929cf633 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353552:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353558:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353563:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353567:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353570:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353575:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353582:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242159100) 00010000:00010000:2.0:1787599455.353584:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353586:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353592:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf672 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353619:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353625:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353631:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353637:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353639:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353645:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353654:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599455.353657:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353659:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353665:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cf77c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353675:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353680:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353685:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353696:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353699:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353704:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353712:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599455.353714:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353716:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353721:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929cf79f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353734:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353739:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353745:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353750:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.353753:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353758:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353775:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599455.353778:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.353780:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.353786:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cf7e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.356643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.356714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559016064 00000100:00100000:3.0:1787599455.356724:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559016064 00000100:00100000:3.0:1787599455.356785:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1787599455.356829:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+12:11304:x1874433559016064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599455.356850:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599455.356869:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf8a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbac expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.356966:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.356979:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.356989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599455.356999:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787599455.357092:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357100:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357106:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357111:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599455.357115:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357121:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357131:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:3.0:1787599455.357134:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599455.357138:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357144:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357183:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf8a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbac expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357193:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:3.0:1787599455.357194:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599455.357198:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf8a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbac expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.357218:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:3.0:1787599455.357290:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 496us (656us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787599455.357298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1787599455.373706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.373787:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559016192 00000100:00100000:0.0:1787599455.373829:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559016192 00000100:00100000:0.0:1787599455.373884:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1787599455.373906:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016192:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599455.373942:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599455.374050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016192:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 146us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.374057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1787599455.387510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.395734:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559016448 00000100:00100000:2.0:1787599455.395749:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559016448 00000100:00100000:2.0:1787599455.395849:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:2.0:1787599455.395862:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016448:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.395884:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599455.395887:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599455.395917:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf863 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb9e expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.395936:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599455.395941:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599455.395955:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf8be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbb3 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599455.396401:0:10099:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787599455.396541:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf8c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.396554:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.396575:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.396630:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cf8be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbb3 expref: 15 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.396645:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbb3 expref: 14 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.396653:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b342bf1800) 00010000:00010000:2.0:1787599455.396656:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599455.396659:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759c00, rc 0) 00000100:00100000:2.0:1787599455.396726:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559016448:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 866us (9225us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787599455.396733:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1787599455.406430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.406520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559016704 00000100:00100000:2.0:1787599455.406532:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559016704 00000100:00100000:2.0:1787599455.406596:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1787599455.406615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559016704:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.406676:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599455.406704:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbb3 expref: 14 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406724:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b342bf1800) 00010000:00010000:2.0:1787599455.406739:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599455.406770:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406813:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406881:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406890:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406897:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406939:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406946:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406954:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406961:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.406965:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406973:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.406982:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599455.406990:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.406994:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407001:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf8d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407012:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407019:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407025:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407031:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.407034:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407041:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407048:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe4fc24e2 (ffff96b342bf1000) 00010000:00010000:2.0:1787599455.407051:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599455.407054:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.407060:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf8da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe4fc24e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.407133:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016704:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 527us (713us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599455.407145:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1787599455.418864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.422895:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559016832 00000100:00100000:3.0:1787599455.422909:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559016832 00000100:00100000:3.0:1787599455.422979:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1787599455.422989:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11304:x1874433559016832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599455.423009:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599455.423034:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf8e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbba expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423066:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423078:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423089:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423191:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf8e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 15 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423209:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 14 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.423243:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:3.0:1787599455.423246:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599455.423249:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599455.423315:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559016832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 327us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599455.423323:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1787599455.439926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.443145:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017088 00000100:00100000:1.0:1787599455.443243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017088 00000100:00100000:1.0:1787599455.444690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1787599455.444717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559017088:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599455.444833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.444850:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.444864:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599455.445071:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787599455.445081:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402064287837ns, next at 403064285214ns, rc = 0 00000004:00010000:1.0:1787599455.445137:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cb43e0d reply state 0000000049951c08 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.445151:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.445158:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:1.0:1787599455.445162:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787599455.445166:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599455.445289:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11304:x1874433559017088:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 583us (5373us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787599455.445297:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1787599455.449909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.449942:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017216 00000100:00100000:1.0:1787599455.449953:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017216 00000100:00100000:1.0:1787599455.450009:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1787599455.450019:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11304:x1874433559017216:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599455.450043:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599455.450063:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbc1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.450116:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.450129:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.450524:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:1.0:1787599455.450529:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599455.450533:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a000, rc 0) 00000100:00100000:1.0:1787599455.452254:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11304:x1874433559017216:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2226us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599455.452266:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1787599455.459396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.459552:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017344 00000100:00100000:2.0:1787599455.459561:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017344 00000100:00100000:2.0:1787599455.459612:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1787599455.459621:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559017344:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787599455.459654:0:8629:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:2.0:1787599455.459686:0:8629:0:(genops.c:1385:class_connect()) connect: client 4ef2ef44-63df-45fd-9e68-c54398cec083, cookie 0x5d2988b0929cf8fd 00002000:00100000:2.0:1787599455.459698:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4ef2ef44-63df-45fd-9e68-c54398cec083/ffff96b351f6d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599455.459716:0:8629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599455.459812:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599455.459851:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b351f6a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599455.459926:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2402:x1874433559017344:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 Request processed in 304us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.459934:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1787599455.462031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.463521:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017472 00000100:00100000:1.0:1787599455.463534:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017472 00000100:00080000:3.0:1787599455.463606:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599455.463612:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1787599455.463625:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:0:x1874433559017472:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000001:00080000:3.0:1787599455.464989:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1787599455.465017:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000100:00100000:1.0:1787599455.465558:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:0:x1874433559017472:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 1930us (3531us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787599455.465568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00010000:00010000:2.0:1787599455.466336:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599455.490018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.490308:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017728 00000100:00100000:2.0:1787599455.490319:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017728 00000100:00100000:3.0:1787599455.491107:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599455.491125:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11304:x1874433559017728:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599455.491507:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11304:x1874433559017728:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 387us (1499us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1787599455.491516:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1787599455.503413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.503661:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559017984 00000100:00100000:0.0:1787599455.503674:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559017984 00000100:00100000:0.0:1787599455.503758:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1787599455.503772:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11304:x1874433559017984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599455.503950:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11304:x1874433559017984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 180us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.503958:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1787599455.515462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.515631:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018112 00000100:00100000:2.0:1787599455.515642:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018112 00000100:00100000:2.0:1787599455.515709:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1787599455.515720:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11304:x1874433559018112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.515745:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599455.515809:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf904 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbc8 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.515903:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.515919:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.515931:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599455.515977:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599455.515996:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.516021:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cf904 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc8 expref: 20 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.516037:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc8 expref: 19 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.516045:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:2.0:1787599455.516048:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787599455.516051:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759c00, rc 0) 00000100:00100000:2.0:1787599455.516128:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11304:x1874433559018112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 409us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.516136:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1787599455.529578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.529761:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018240 00000100:00100000:0.0:1787599455.529773:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018240 00000100:00100000:0.0:1787599455.529910:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1787599455.529924:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559018240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599455.529948:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599455.529976:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbcf expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599455.530010:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a5f, blocks: 0x0 00010000:00010000:0.0:1787599455.530036:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1787599455.530041:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599455.530052:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.530100:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.530116:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324600, rc 0) 00000100:00100000:0.0:1787599455.530187:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559018240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 267us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.530195:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1787599455.540401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.541420:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018496 00000100:00100000:0.0:1787599455.541431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018496 00000100:00100000:0.0:1787599455.541499:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1787599455.541509:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11304:x1874433559018496:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599455.541619:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11304:x1874433559018496:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.541627:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1787599455.546542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.549788:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018624 00000100:00100000:3.0:1787599455.549824:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018624 00000100:00100000:2.0:1787599455.549970:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1787599455.549984:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:11304:x1874433559018624:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.550024:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599455.550053:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbd6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.550090:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.550102:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599455.550106:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599455.550112:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.550147:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.550163:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.550177:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577977344:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.550464:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599455.556410:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577977344:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599455.556453:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.556477:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599455.556546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11304:x1874433559018624:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 6565us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.556555:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1787599455.559243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.559338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018752 00000100:00100000:3.0:1787599455.559348:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018752 00010000:00010000:3.0:1787599455.559389:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599455.559450:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1787599455.559460:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559018752:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599455.559475:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599455.559498:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.559511:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.559536:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005682d22d/0x5d2988b0929cf912 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbcf expref: 7 pid: 8629 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.559553:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599455.559557:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599455.559566:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.559576:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.559613:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599455.559699:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874433577977472:192.168.202.1@tcp:105: 00000100:00100000:3.0:1787599455.561776:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599455.566745:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874433577977472:192.168.202.1@tcp:105: 00010000:00010000:3.0:1787599455.566779:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599455.567517:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559018752:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8052us (8292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599455.567531:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1787599455.584862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599455.585524:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559018880 00000100:00100000:1.0:1787599455.585536:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559018880 00002000:00100000:1.0:1787599455.585898:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff96b243757800 x1874433559018880/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:311/0 lens 504/0 e 0 to 0 dl 1787599466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599455.585911:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b243757800 with x1874433559018880 ext(0->8) 00002000:00010000:1.0:1787599455.585917:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b243757800 00000100:00100000:1.0:1787599455.585947:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599455.585958:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559018880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787599455.588187:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559018880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 2221us (3326us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787599455.588204:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:0.0:1787599455.588215:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff96b243757800 x1874433559018880/t4294967303(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:311/0 lens 504/448 e 0 to 0 dl 1787599466 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599455.588234:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b243757800 with x1874433559018880 ext(0->8) 00002000:00010000:0.0:1787599455.588246:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b243757800 00000100:00100000:3.0:1787599455.603664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.603754:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019008 00000100:00100000:0.0:1787599455.603765:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019008 00000100:00100000:0.0:1787599455.603846:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1787599455.603857:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11304:x1874433559019008:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787599455.606710:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787599455.606731:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787599455.606763:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1787599455.606896:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606910:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606919:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606927:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599455.606931:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606939:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606957:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:0.0:1787599455.606959:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787599455.606965:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.606970:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf8ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787599455.607010:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787599455.607022:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787599455.607177:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559019008:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 3316us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.607187:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1787599455.607420:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599455.607438:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577977600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787599455.607494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599455.609278:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577977600 00000100:00100000:3.0:1787599455.609294:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577977600 00000100:00100000:3.0:1787599455.609355:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599455.609366:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577977600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787599455.609508:0:8629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787599455.609511:0:8629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787599455 00002000:00010000:3.0:1787599455.609514:0:8629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787599455.609516:0:8629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787599455 -> 1787599455 00002000:00010000:3.0:1787599455.609519:0:8629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787599455.609594:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577977600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (2099us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787599455.609602:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787599455.609651:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b243409c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787599455.609657:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577977600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787599455.610111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.610243:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019136 00000100:00100000:3.0:1787599455.610248:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019136 00000100:00100000:3.0:1787599455.610284:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1787599455.610298:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559019136:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787599455.612007:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787599455.612021:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787599455.620247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559019136:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 9936us (10125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599455.620261:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1787599455.643037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.643638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019392 00000100:00100000:0.0:1787599455.643651:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019392 00000100:00100000:0.0:1787599455.643713:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1787599455.643725:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559019392:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599455.643781:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599455.643841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf90b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc8 expref: 14 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.643861:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:0.0:1787599455.643867:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599455.643923:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.643938:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.643948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599455.644095:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ff9fb07 reply state 00000000d67e3a0d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.644106:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.644111:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:0.0:1787599455.644114:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599455.644123:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599455.644221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+15:11304:x1874433559019392:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 497us (1193us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787599455.644238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1787599455.659789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.663571:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019520 00000100:00100000:3.0:1787599455.663587:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019520 00000100:00100000:3.0:1787599455.676037:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1787599455.676068:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559019520:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787599455.676253:0:8629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787599455.676257:0:8629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787599455 -> 1787599454 00002000:00010000:3.0:1787599455.676259:0:8629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787599453 00002000:00010000:3.0:1787599455.676261:0:8629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787599455 -> 1787599454 00002000:00010000:3.0:1787599455.676263:0:8629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787599455.676342:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559019520:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 290us (16560us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787599455.676350:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1787599455.678181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.678251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019776 00000100:00100000:2.0:1787599455.678261:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019776 00000100:00100000:2.0:1787599455.678317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1787599455.678327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+15:11304:x1874433559019776:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.678399:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.678415:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 15 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.678425:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.678463:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 15 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.678477:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 15 pid: 13004 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.678492:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577977728:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.678589:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599455.681959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599455.681990:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577977728:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.682015:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559019904 00000100:00100000:2.0:1787599455.682023:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559019904 00010000:00010000:3.0:1787599455.682035:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682062:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 16 pid: 13004 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.682101:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1787599455.682111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+16:2404:x1874433559019904:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599455.682126:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599455.682134:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 16 pid: 13004 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682147:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 16 pid: 13004 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682173:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cf8e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbba expref: 16 pid: 13004 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682193:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:2.0:1787599455.682200:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682211:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682220:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.682250:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599455.682305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+15:2404:x1874433559019904:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 195us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.682319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00010000:00010000:3.0:1787599455.682675:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682684:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682721:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682739:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682751:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682757:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599455.682762:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682769:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682780:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:3.0:1787599455.682783:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787599455.682787:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599455.682836:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cf927 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599455.683102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559019776:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 4774us (4929us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787599455.683113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1787599455.685845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.685952:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020032 00000100:00100000:0.0:1787599455.685963:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020032 00000100:00100000:0.0:1787599455.686033:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1787599455.686044:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559020032:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787599455.686085:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.686106:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.686114:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599455.686118:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599455.686123:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.686157:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.686171:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.686186:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577977856:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599455.686296:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599455.689870:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.689906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020160 00000100:00100000:0.0:1787599455.689916:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020160 00010000:00010000:0.0:1787599455.689954:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 8 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.690242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1787599455.690253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559020160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599455.690270:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599455.690293:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 8 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690307:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 8 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690331:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599455.690336:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599455.690342:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690353:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690374:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599455.690436:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559020160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.690459:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00010000:00010000:0.0:1787599455.690513:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929cf919 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbd6 expref: 7 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.690526:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577977856:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599455.690545:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690555:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690563:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690580:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690589:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690597:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.690604:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599455.690608:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.692602:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.692733:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.692744:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf92e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.692853:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559020032:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 6806us (7014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.692862:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1787599455.712329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.713211:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020416 00000100:00100000:2.0:1787599455.713235:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020416 00000100:00100000:2.0:1787599455.713305:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:2.0:1787599455.713317:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11304:x1874433559020416:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787599455.713405:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.713422:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.713431:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.713463:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.713476:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 14 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.713491:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577977984:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.713578:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2440666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599455.724419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.724533:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577977984:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599455.724563:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599455.725817:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020544 00000100:00100000:1.0:1787599455.725829:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020544 00010000:00010000:1.0:1787599455.725868:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599455.725912:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1787599455.725921:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+15:2404:x1874433559020544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599455.725934:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599455.725941:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.725954:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.725974:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929cf775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb5f expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.725999:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599455.726005:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.726016:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.726035:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.726063:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599455.726117:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+14:2404:x1874433559020544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 196us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599455.726124:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00010000:00010000:2.0:1787599455.726219:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726238:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726402:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726415:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726424:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726451:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.726464:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 14 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.726477:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577978112:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.726529:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2440660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599455.731143:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577978112:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599455.731174:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.735099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599455.735920:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020672 00000100:00100000:0.0:1787599455.735934:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020672 00010000:00010000:0.0:1787599455.735979:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.736049:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1787599455.736059:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+15:2403:x1874433559020672:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599455.736074:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599455.736081:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736093:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736114:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf8f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbc1 expref: 15 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736128:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:0.0:1787599455.736133:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736143:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736151:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.736174:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599455.736239:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+14:2403:x1874433559020672:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 182us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.736247:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00010000:00010000:2.0:1787599455.742182:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.742200:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599455.742314:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787599455.742422:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787599455.742450:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787599455.742527:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10099:1874433577978240:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787599455.742601:0:10099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599455.742633:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599455.742888:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577978240 00000100:00100000:0.0:1787599455.742903:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577978240 00000100:00100000:0.0:1787599455.742961:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787599455.742972:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10099:x1874433577978240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787599455.743073:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10099:x1874433577978240:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599455.743080:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787599455.743366:0:10099:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787599455.743371:0:10099:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b243409c00, transno 4294967304 00000100:00100000:2.0:1787599455.743391:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10099:1874433577978240:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787599455.743498:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787599455.743546:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10099:1874433577978368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787599455.743573:0:10099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599455.743594:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599455.743610:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577978368 00000100:00100000:2.0:1787599455.743614:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577978368 00000100:00100000:2.0:1787599455.743637:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787599455.743643:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10099:x1874433577978368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787599455.743737:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10099:x1874433577978368:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (162us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787599455.743743:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787599455.743770:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10099:1874433577978368:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787599455.743826:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743837:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743844:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743850:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.743856:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743875:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743893:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:2.0:1787599455.743896:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599455.743901:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743907:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cf93c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743937:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743944:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743951:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743957:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599455.743960:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743966:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.743974:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599455.743976:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599455.743980:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744010:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324400/0x5d2988b0929cf86a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744033:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744048:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 17 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744057:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744078:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 17 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.744091:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 17 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.744102:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577978496:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.744157:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599455.749979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.750029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559020800 00000100:00100000:2.0:1787599455.750040:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559020800 00010000:00010000:2.0:1787599455.750084:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 18 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.750121:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599455.750132:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:2403:x1874433559020800:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599455.750160:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599455.750167:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 18 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.750180:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 18 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.750204:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:2.0:1787599455.750209:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.750216:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.750233:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.750257:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599455.750370:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cf886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbba5 expref: 18 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599455.750387:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577978496:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599455.750400:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+17:2403:x1874433559020800:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 271us (428us total) trans 0 rc 0/0 00010000:00010000:1.0:1787599455.750406:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599455.750407:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00010000:00010000:1.0:1787599455.750415:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750421:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750432:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750439:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750445:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750451:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599455.750462:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750469:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750478:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599455.750481:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599455.750485:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750491:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cf943 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750500:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750505:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750510:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750515:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599455.750518:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750523:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750530:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242159200) 00010000:00010000:1.0:1787599455.750532:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599455.750540:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599455.750545:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cf935 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599455.750697:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11304:x1874433559020416:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 37382us (38376us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787599455.750706:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000020:00080000:1.0:1787599455.750709:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787599455.750755:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599455.750760:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599455.750776:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787599455.750781:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599455.760709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599455.760744:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559021056 00000100:00100000:2.0:1787599455.760755:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559021056 00000100:00100000:0.0:1787599455.761148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599455.761160:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11304:x1874433559021056:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787599455.761489:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787599455.761518:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787599455.761547:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761561:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761569:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761574:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761578:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761582:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599455.761598:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599455.761690:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599455.761696:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599455.761699:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11304:x1874433559021056:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 540us (999us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787599455.761707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:2.0:1787599455.761709:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324600 already unused, calling callback (ffffffffc0b4e230) 00000020:00080000:0.0:1787599455.761711:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787599455.761713:0:10398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.761720:0:10398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.761733:0:10398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:2.0:1787599455.761736:0:10398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787599455.761741:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.761747:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cf94a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599455.761758:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599455.761759:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599455.761761:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599455.781557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577978624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599455.781627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599455.782582:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577978624 00000100:00100000:2.0:1787599455.782592:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577978624 00000100:00100000:2.0:1787599455.782639:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787599455.782648:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577978624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599455.782677:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787599455.782734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577978624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599455.782741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787599455.782826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577978624:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787599456.151789:0:14214:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787599456.152146:0:14214:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787599456.152176:0:14214:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787599456.152183:0:14214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599456.251305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.251499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559021312 00000100:00100000:2.0:1787599456.251509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559021312 00000100:00100000:2.0:1787599456.251575:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1787599456.251598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+18:11314:x1874433559021312:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599456.251624:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599456.251646:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbdd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.251774:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf958 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.251788:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.251819:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599456.251830:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787599456.251927:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbdd expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.251944:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbdd expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.251953:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599456.251956:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599456.251959:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758600, rc 0) 00000100:00100000:2.0:1787599456.252018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+20:11314:x1874433559021312:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 423us (723us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787599456.252025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00080000:3.0:1787599456.252091:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599456.257451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.258559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559021440 00000100:00100000:3.0:1787599456.258573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559021440 00000100:00100000:3.0:1787599456.258646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1787599456.258656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+20:11314:x1874433559021440:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1787599456.258735:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258751:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258763:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258786:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258813:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258904:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258913:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258920:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599456.258964:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258984:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258990:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.258997:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259002:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599456.259006:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259014:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259026:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599456.259028:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599456.259033:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259039:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf966 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259049:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259055:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259061:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259285:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599456.259291:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259298:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259306:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b242e62500) 00010000:00010000:3.0:1787599456.259308:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599456.259311:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259317:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf96d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259331:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259338:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259344:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259350:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599456.259352:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259358:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259376:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b242e62200) 00010000:00010000:3.0:1787599456.259378:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599456.259381:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.259387:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.259484:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+20:11314:x1874433559021440:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 827us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.259492:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1787599456.314523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.315007:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559021696 00000100:00100000:1.0:1787599456.315018:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559021696 00000100:00100000:1.0:1787599456.315068:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1787599456.315079:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+20:11317:x1874433559021696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599456.315098:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599456.315118:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf97b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbe4 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315191:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315206:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315229:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315260:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315268:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315275:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315607:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315617:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315624:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599456.315634:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787599456.315704:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315712:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315718:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315725:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.315729:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315757:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315769:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599456.315773:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599456.315777:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315782:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315821:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315827:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315832:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315837:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.315840:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315846:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315853:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b370675000) 00010000:00010000:1.0:1787599456.315855:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599456.315858:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.315874:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.316084:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf97b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 23 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.316099:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 22 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.316107:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:1.0:1787599456.316109:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599456.316112:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a200, rc 0) 00000100:00100000:1.0:1787599456.316172:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11317:x1874433559021696:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1093us (1659us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787599456.316179:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1787599456.327714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.332359:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559021824 00000100:00100000:2.0:1787599456.332382:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559021824 00000100:00100000:2.0:1787599456.332457:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1787599456.332469:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11317:x1874433559021824:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1787599456.332534:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332550:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332561:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332597:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332603:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332610:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332616:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.332620:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332627:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332638:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.332640:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599456.332644:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.332658:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cf99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599456.332738:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11317:x1874433559021824:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 270us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599456.332746:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1787599456.336840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.336924:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022080 00000100:00100000:2.0:1787599456.336935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022080 00000100:00100000:2.0:1787599456.336991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599456.337002:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11317:x1874433559022080:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1787599456.337196:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+23:11317:x1874433559022080:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 195us (363us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787599456.337205:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599456.375265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.375359:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022336 00000100:00100000:3.0:1787599456.375368:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022336 00000100:00100000:3.0:1787599456.375433:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:3.0:1787599456.375445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+23:10841:x1874433559022336:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599456.375470:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599456.375492:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf9a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.375585:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.375595:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.375601:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.375642:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.375651:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 24 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.375662:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577978752:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599456.375753:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599456.379011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.379136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022464 00000100:00100000:1.0:1787599456.379147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022464 00010000:00010000:1.0:1787599456.379187:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 25 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599456.379187:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577978752:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599456.379214:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.379238:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1787599456.379248:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+25:2404:x1874433559022464:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599456.379264:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599456.379270:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 25 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379310:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 25 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379331:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cf990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbe4 expref: 25 pid: 10099 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379346:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:1.0:1787599456.379351:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379360:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379367:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.379401:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599456.379455:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+24:2404:x1874433559022464:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 207us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.379463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:0.0:1787599456.380140:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.380150:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599456.380169:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787599456.380304:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cf9a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.380320:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.380329:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:0.0:1787599456.380331:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787599456.380335:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:0.0:1787599456.380374:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+24:10841:x1874433559022336:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4931us (5119us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787599456.380393:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1787599456.384177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.385518:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022592 00000100:00100000:1.0:1787599456.385532:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022592 00000100:00100000:1.0:1787599456.385602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1787599456.385613:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+24:10841:x1874433559022592:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599456.385712:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599456.385816:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbf2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386021:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf9c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386035:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386049:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386161:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf2 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386183:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf2 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.386192:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:1.0:1787599456.386195:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599456.386199:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599456.386352:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:10841:x1874433559022592:12345-192.168.202.1@tcp:101:bash.0 Request processed in 739us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.386361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1787599456.391433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.391835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022848 00000100:00100000:2.0:1787599456.391846:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022848 00000100:00100000:2.0:1787599456.391904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:2.0:1787599456.391915:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+25:10841:x1874433559022848:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1787599456.392112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.392125:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.392133:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599456.392194:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1787599456.392226:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c47f7233 reply state 00000000b09f5f5e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.392239:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.392245:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.392248:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599456.392251:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787599456.392324:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787599456.392427:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+29:10841:x1874433559022848:12345-192.168.202.1@tcp:36:bash.0 Request processed in 513us (1002us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787599456.392435:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000020:00080000:2.0:1787599456.392440:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787599456.395490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.395585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559022976 00000100:00100000:3.0:1787599456.395595:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559022976 00000100:00100000:3.0:1787599456.395651:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1787599456.395661:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+29:10841:x1874433559022976:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599456.395687:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599456.395711:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf9cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbbf9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.395771:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf9cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf9 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.395786:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf9cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf9 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.395842:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:3.0:1787599456.395845:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599456.395849:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c000, rc 0) 00000100:00100000:3.0:1787599456.395935:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+30:10841:x1874433559022976:12345-192.168.202.1@tcp:101:bash.0 Request processed in 274us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.395942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1787599456.398883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599456.398985:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559023104 00000100:00100000:0.0:1787599456.399007:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559023104 00000100:00100000:0.0:1787599456.399067:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1787599456.399077:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:10841:x1874433559023104:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599456.399094:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599456.399116:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc00 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599456.399143:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c9a5e, atime: 0x6a8c9a5d, ctime: 0x6a8c9a5e, blocks: 0x8 00010000:00010000:0.0:1787599456.399163:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1787599456.399168:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599456.399176:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.399193:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.399204:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325000, rc 0) 00000100:00100000:0.0:1787599456.399270:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:10841:x1874433559023104:12345-192.168.202.1@tcp:101:bash.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599456.399284:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1787599456.401576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.401770:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559023232 00000100:00100000:2.0:1787599456.401779:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559023232 00002000:00010000:2.0:1787599456.401852:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787599456.401857:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2436fca80 with x1874433559023232 ext(0->18446744073709551615) 00002000:00010000:2.0:1787599456.401869:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2436fca80. 00000100:00100000:2.0:1787599456.401902:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1787599456.401912:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559023232:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:2.0:1787599456.402274:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787599456.402278:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787599454 -> 1787599456 00002000:00010000:2.0:1787599456.402281:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787599453 -> 1787599453 00002000:00010000:2.0:1787599456.402283:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787599454 -> 1787599456 00002000:00010000:2.0:1787599456.402296:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787599456.402400:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559023232:12345-192.168.202.1@tcp:10:bash.0 Request processed in 487us (830us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787599456.402408:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00010000:2.0:1787599456.402412:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787599456.402415:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2436fca80 with x1874433559023232 ext(0->18446744073709551615) 00002000:00010000:2.0:1787599456.402420:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2436fca80. 00010000:00010000:0.0:1787599456.485623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599456.490717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.490842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559023360 00000100:00100000:1.0:1787599456.490853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559023360 00000100:00100000:1.0:1787599456.490915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1787599456.490926:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11331:x1874433559023360:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1787599456.490995:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491025:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491039:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491054:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491062:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491080:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491150:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491160:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491168:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599456.491209:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491238:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491245:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491261:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491268:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.491271:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491278:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599456.491294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599456.491298:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491303:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cf9dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491316:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491322:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491327:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491332:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.491336:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491352:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491361:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b370675000) 00010000:00010000:1.0:1787599456.491364:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599456.491367:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cf9e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491402:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491410:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491416:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491422:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.491425:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491432:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491439:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:1.0:1787599456.491442:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599456.491445:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.491461:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cf9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.491542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11331:x1874433559023360:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 617us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.491551:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1787599456.538923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.539100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559023616 00000100:00100000:2.0:1787599456.539110:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559023616 00000100:00100000:2.0:1787599456.539175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1787599456.539187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11334:x1874433559023616:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599456.539209:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599456.539240:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cf9f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc07 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539316:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539331:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539341:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539355:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539504:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfa07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfa07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539521:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfa07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599456.539531:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787599456.539608:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539615:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539622:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539627:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.539631:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539638:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539650:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599456.539653:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599456.539664:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539671:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cf9f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539685:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539691:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539696:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539701:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.539704:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539710:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539718:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599456.539720:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599456.539723:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539728:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfa00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539766:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cf9f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc07 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539854:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfa07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc07 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.539863:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.539865:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787599456.539868:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759e00, rc 0) 00000100:00100000:2.0:1787599456.539925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11334:x1874433559023616:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 740us (1013us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787599456.539933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1787599456.545065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.545242:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559023744 00000100:00100000:2.0:1787599456.545253:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559023744 00000100:00100000:2.0:1787599456.545320:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1787599456.545331:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11334:x1874433559023744:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1787599456.545413:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.545430:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.545440:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.545474:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.545488:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 32 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599456.545517:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577978880:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599456.545627:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599456.550045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.550319:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2435afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577978880:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599456.550348:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.550472:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559024000 00000100:00100000:3.0:1787599456.550481:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559024000 00000100:00100000:3.0:1787599456.550542:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1787599456.550552:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+33:6174:x1874433559024000:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787599456.550900:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+34:6174:x1874433559024000:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 347us (866us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787599456.550908:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1787599456.553704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.553981:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559024128 00000100:00100000:2.0:1787599456.553991:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559024128 00010000:00010000:2.0:1787599456.554035:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 34 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599456.554192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1787599456.554203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+34:2404:x1874433559024128:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599456.554236:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599456.554254:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 34 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554270:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 34 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554293:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cf9ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbeb expref: 34 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554310:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.554315:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554341:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554349:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.554390:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599456.554452:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+33:2404:x1874433559024128:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 251us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599456.554461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00010000:00010000:3.0:1787599456.554542:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554551:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554588:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554596:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554604:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554621:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599456.554626:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554634:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554643:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:3.0:1787599456.554646:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599456.554649:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.554655:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfa15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.554695:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11334:x1874433559023744:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 9366us (9640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.554704:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1787599456.559507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.559618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559024384 00000100:00100000:1.0:1787599456.559631:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559024384 00000100:00100000:1.0:1787599456.559694:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1787599456.559704:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:11334:x1874433559024384:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599456.559981:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+33:11334:x1874433559024384:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 278us (484us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787599456.559989:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1787599456.650331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.650433:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559024640 00000100:00100000:2.0:1787599456.650444:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559024640 00000100:00100000:2.0:1787599456.650509:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1787599456.650520:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+33:11345:x1874433559024640:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1787599456.650547:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599456.650569:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfa1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc0e expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650646:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650661:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650671:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650686:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650713:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.650721:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651010:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651022:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651030:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599456.651042:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787599456.651119:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651127:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651134:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651140:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.651144:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651152:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651175:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599456.651178:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599456.651183:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651190:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651204:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651211:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651229:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651236:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.651239:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651247:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651255:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599456.651257:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599456.651261:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651267:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651323:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfa1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc0e expref: 36 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651338:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc0e expref: 35 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.651346:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.651349:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599456.651351:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:2.0:1787599456.651420:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11345:x1874433559024640:12345-192.168.202.1@tcp:101:cat.0 Request processed in 900us (1099us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787599456.651428:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1787599456.658439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.658542:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559024896 00000100:00100000:1.0:1787599456.658553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559024896 00000100:00100000:1.0:1787599456.658616:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1787599456.658627:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11345:x1874433559024896:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1787599456.658981:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+36:11345:x1874433559024896:12345-192.168.202.1@tcp:35:cat.0 Request processed in 353us (550us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787599456.658990:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1787599456.687656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.687776:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559025152 00000100:00100000:2.0:1787599456.687786:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559025152 00000100:00100000:2.0:1787599456.687891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1787599456.687902:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+36:11346:x1874433559025152:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1787599456.687959:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787599456.687987:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cf9cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf9 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688010:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc0e expref: 35 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688024:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfa07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc07 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688058:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cf9c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbf2 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688069:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.688075:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599456.688097:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688109:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688119:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688133:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688139:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688145:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688233:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688242:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688249:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599456.688489:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787599456.688500:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403307707193ns, next at 404307704545ns, rc = 0 00010000:00010000:2.0:1787599456.688545:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688555:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688563:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688571:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688578:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688584:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688610:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599456.688628:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688635:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688641:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688646:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.688658:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688665:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688674:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599456.688677:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787599456.688681:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfa4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688705:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688712:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688718:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688723:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599456.688727:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688733:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599456.688742:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599456.688752:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688758:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfa3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599456.688769:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a799a96a reply state 000000007ea48fb9 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688779:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.688785:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599456.688788:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599456.688830:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599456.688906:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+34:11346:x1874433559025152:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1004us (1257us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787599456.688915:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00010000:00010000:3.0:1787599456.689175:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599456.689183:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.689189:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599456.689192:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.689198:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.689227:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:3.0:1787599456.689229:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599456.689233:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.689239:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfa54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.689251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599456.689253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599456.689255:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599456.758166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.758238:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559025408 00000100:00100000:3.0:1787599456.758250:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559025408 00000100:00100000:3.0:1787599456.758357:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:3.0:1787599456.758368:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+34:11352:x1874433559025408:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599456.758392:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599456.758413:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfa5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc15 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758523:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758540:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758552:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758563:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758587:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.758594:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599456.759008:0:13004:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787599456.759163:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759173:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759180:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759224:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759231:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759237:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759242:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599456.759246:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759252:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759275:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599456.759278:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599456.759283:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759289:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfa62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599456.759303:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070ab34f6 reply state 00000000a1eee4df transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759313:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759319:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:3.0:1787599456.759321:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599456.759325:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787599456.759352:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfa5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 37 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759366:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 36 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.759373:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:3.0:1787599456.759376:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599456.759378:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d400, rc 0) 00000100:00100000:3.0:1787599456.759454:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+37:11352:x1874433559025408:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1088us (1296us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787599456.759463:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1787599456.763428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.763554:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559025536 00000100:00100000:3.0:1787599456.763567:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559025536 00000100:00100000:3.0:1787599456.763674:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1787599456.763684:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559025536:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599456.763703:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599456.763724:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc1c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599456.763749:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599456.763769:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1787599456.763774:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599456.763784:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.763839:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.763854:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599456.763918:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2406:x1874433559025536:12345-192.168.202.1@tcp:101:bash.0 Request processed in 235us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.763926:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00080000:1.0:1787599456.764146:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599456.769144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.769239:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559025664 00000100:00100000:1.0:1787599456.769250:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559025664 00000100:00100000:1.0:1787599456.769358:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1787599456.769384:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:11352:x1874433559025664:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599456.769404:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599456.769424:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc23 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.769454:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.769463:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599456.769467:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599456.769472:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.769507:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.769522:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.769536:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577979008:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599456.769637:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599456.778466:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577979008:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599456.778516:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.778560:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a000, rc 0) 00000100:00100000:1.0:1787599456.778700:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:11352:x1874433559025664:12345-192.168.202.1@tcp:101:bash.0 Request processed in 9317us (9568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.778710:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1787599456.781616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.782699:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559025792 00000100:00100000:1.0:1787599456.782714:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559025792 00010000:00010000:1.0:1787599456.782764:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.782834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1787599456.782845:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559025792:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599456.782862:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599456.782894:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.782912:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.782941:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009050b427/0x5d2988b0929cfa7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc1c expref: 9 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.782959:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599456.782965:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599456.782974:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.783016:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.783061:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.783076:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874433577979136:192.168.202.1@tcp:105: 00000100:00100000:1.0:1787599456.783184:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599456.790846:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874433577979136:192.168.202.1@tcp:105: 00010000:00010000:1.0:1787599456.790874:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599456.790955:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559025792:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8110us (9351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.790966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1787599456.795891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.796061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026048 00000100:00100000:1.0:1787599456.796083:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026048 00000100:00100000:1.0:1787599456.796154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1787599456.796166:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+37:11352:x1874433559026048:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1787599456.796548:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11352:x1874433559026048:12345-192.168.202.1@tcp:35:bash.0 Request processed in 382us (666us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787599456.796556:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599456.934621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.934751:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026176 00000100:00100000:1.0:1787599456.934761:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026176 00000100:00100000:0.0:1787599456.935451:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1787599456.935470:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+38:11368:x1874433559026176:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599456.935514:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599456.935536:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfa8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc2a expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935611:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935626:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935638:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599456.935682:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787599456.935686:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599456.935706:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935731:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfa8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc2a expref: 40 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935751:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc2a expref: 39 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.935761:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:0.0:1787599456.935764:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599456.935767:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324000, rc 0) 00000100:00100000:0.0:1787599456.935887:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+39:11368:x1874433559026176:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 423us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599456.935895:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:3.0:1787599456.938877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599456.939638:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026432 00000100:00100000:2.0:1787599456.939651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026432 00000100:00100000:2.0:1787599456.939756:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:2.0:1787599456.939768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+39:11368:x1874433559026432:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599456.939789:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599456.939836:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.939967:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfaa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.939981:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.939993:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599456.940004:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599456.940487:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfa9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc31 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.940508:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc31 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.940517:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:2.0:1787599456.940521:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599456.940524:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758800, rc 0) 00000100:00100000:2.0:1787599456.940584:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+41:11368:x1874433559026432:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 817us (1719us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787599456.940592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1787599456.943758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.943842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.943895:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026816 00000100:00100000:3.0:1787599456.943905:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026816 00000100:00100000:3.0:1787599456.943970:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1787599456.943981:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+41:2403:x1874433559026816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599456.943998:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599456.944022:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfaa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc31 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.944040:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:3.0:1787599456.944045:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599456.944095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+40:2403:x1874433559026816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.944103:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599456.945486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026688 00000100:00100000:2.0:1787599456.945499:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026688 00000100:00100000:2.0:1787599456.945603:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1787599456.945613:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+40:11368:x1874433559026688:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599456.945636:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599456.945671:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfaaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.945916:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.945934:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.945945:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599456.946048:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599456.946171:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfaaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc38 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.946191:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc38 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599456.946200:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:2.0:1787599456.946203:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787599456.946206:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599456.946332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+42:11368:x1874433559026688:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 719us (2581us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787599456.946340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:3.0:1787599456.950720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.950773:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559026944 00000100:00100000:3.0:1787599456.950784:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559026944 00000100:00100000:3.0:1787599456.950871:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1787599456.950882:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559026944:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1787599456.950926:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.950947:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.950956:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599456.950961:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599456.950966:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.951035:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.951051:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 8 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.951065:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874433577979264:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599456.951151:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599456.954593:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874433577979264:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599456.954685:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599456.955595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.955970:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027072 00000100:00100000:1.0:1787599456.955980:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027072 00002000:00100000:1.0:1787599456.956048:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff96b38138c380 x1874433559027072/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:312/0 lens 504/0 e 0 to 0 dl 1787599467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599456.956060:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b38138c380 with x1874433559027072 ext(0->8) 00010000:00010000:1.0:1787599456.956069:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 9 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.956084:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 9 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599456.956092:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b38138c380 00000100:00100000:1.0:1787599456.956125:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1787599456.956135:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559027072:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1787599456.957308:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2404:x1874433559027072:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1165us (1713us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787599456.957320:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:1.0:1787599456.957329:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff96b38138c380 x1874433559027072/t4294967303(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:312/0 lens 504/448 e 0 to 0 dl 1787599467 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599456.957340:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b38138c380 with x1874433559027072 ext(0->8) 00010000:00010000:1.0:1787599456.957349:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.957365:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599456.957374:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b38138c380 00000100:00100000:1.0:1787599456.960255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.960350:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027200 00000100:00100000:3.0:1787599456.960360:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027200 00010000:00010000:3.0:1787599456.960411:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599456.960451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1787599456.960462:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2403:x1874433559027200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599456.960478:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787599456.960497:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787599456.960501:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787599456 00002000:00010000:3.0:1787599456.960503:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787599457 00002000:00010000:3.0:1787599456.960506:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787599456 00002000:00010000:3.0:1787599456.960523:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787599456.960531:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.960545:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.960571:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a05188c7/0x5d2988b0929cfa85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc23 expref: 11 pid: 8433 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.960587:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599456.960592:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599456.960599:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.960610:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599456.960659:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599456.960723:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559027200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 262us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599456.960739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00010000:00010000:0.0:1787599456.960865:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960882:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960903:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960912:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960922:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960930:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599456.960935:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960946:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960959:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.960968:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da7d675f/0x5d2988b0929cfac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599456.961030:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559026944:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 10149us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599456.961038:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1787599456.964148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599456.964259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027456 00000100:00100000:1.0:1787599456.964269:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027456 00000100:00100000:1.0:1787599456.964329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1787599456.964340:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+42:11368:x1874433559027456:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1787599456.964418:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc38 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599456.964606:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1787599456.964639:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787599456.965160:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1787599456.965203:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.965230:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 46 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.965240:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.965276:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 46 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.965291:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 46 pid: 13004 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.965305:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874433577979392:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599456.965401:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599456.968479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.968616:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874433577979392:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599456.968658:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599456.969286:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027584 00000100:00100000:0.0:1787599456.969296:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027584 00010000:00010000:0.0:1787599456.969337:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 47 pid: 13004 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599456.969470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1787599456.969482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+47:2406:x1874433559027584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599456.969502:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599456.969511:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 47 pid: 13004 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969524:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 47 pid: 13004 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969548:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfa70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc15 expref: 47 pid: 13004 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969565:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:0.0:1787599456.969571:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969581:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969603:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.969643:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599456.969755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+46:2406:x1874433559027584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 275us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599456.969764:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00010000:00010000:1.0:1787599456.969928:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.969937:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599456.970042:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787599456.970162:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787599456.970258:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577979520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599456.970311:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599456.970349:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577979520 00000100:00100000:1.0:1787599456.970355:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577979520 00000100:00100000:1.0:1787599456.970408:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787599456.970416:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874433577979520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599456.970480:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874433577979520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599456.970487:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1787599456.970506:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599456.970516:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599456.970537:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577979520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787599456.970651:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787599456.970687:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577979648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599456.970715:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599456.970751:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577979648 00000100:00100000:1.0:1787599456.970755:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577979648 00000100:00100000:1.0:1787599456.970778:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787599456.970784:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1874433577979648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599456.970914:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1874433577979648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (198us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787599456.970927:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787599456.970946:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599456.970964:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874433577979648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787599456.970993:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787599456.971019:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971030:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971038:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971045:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599456.971049:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971058:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971071:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:1.0:1787599456.971074:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787599456.971078:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599456.971085:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfacb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599456.971166:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787599456.971241:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787599456.971259:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403590466253ns, next at 404590464356ns, rc = 0 00000001:00080000:1.0:1787599456.971267:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787599456.971290:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b242e62200) 00010000:00010000:1.0:1787599456.971294:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787599456.971300:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfab6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc38 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599456.971372:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+49:11368:x1874433559027456:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 7034us (7234us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787599456.971381:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000020:00080000:1.0:1787599456.971385:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787599456.974693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599456.974972:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027712 00000100:00100000:0.0:1787599456.974983:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027712 00000100:00100000:0.0:1787599456.975071:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1787599456.975082:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+49:11368:x1874433559027712:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599456.975105:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599456.975128:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfad2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc3f expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.975184:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfad2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc3f expref: 50 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.975199:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfad2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc3f expref: 50 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599456.975229:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599456.975233:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599456.975236:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381325c00, rc 0) 00000100:00100000:0.0:1787599456.975300:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+50:11368:x1874433559027712:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 218us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599456.975307:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1787599456.978453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599456.978584:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559027968 00000100:00100000:3.0:1787599456.978612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559027968 00000100:00100000:3.0:1787599456.978682:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1787599456.978695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+50:11368:x1874433559027968:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599456.978984:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+51:11368:x1874433559027968:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 291us (539us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787599456.978993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1787599457.056111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599457.056349:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559028096 00000100:00100000:3.0:1787599457.056360:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559028096 00000100:00100000:3.0:1787599457.056432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1787599457.056443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+51:11378:x1874433559028096:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1787599457.056521:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056540:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056550:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056562:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056568:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056648:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056675:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056681:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599457.056729:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056742:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056749:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056756:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056761:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599457.056766:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056773:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:3.0:1787599457.056790:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599457.056839:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056869:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056876:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056881:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056886:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599457.056889:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056895:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056903:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:3.0:1787599457.056906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599457.056909:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056916:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056925:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056931:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056935:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056946:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599457.056950:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056956:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:3.0:1787599457.056967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599457.056970:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.056976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599457.057061:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+51:11378:x1874433559028096:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 619us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599457.057190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:1.0:1787599457.100442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.100547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559028352 00000100:00100000:2.0:1787599457.100558:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559028352 00000100:00100000:2.0:1787599457.100646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:2.0:1787599457.100658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+51:11381:x1874433559028352:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599457.100678:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.100700:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfaee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc46 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100787:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100843:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100856:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100877:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.100884:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101003:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101013:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101021:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.101042:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599457.101115:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101124:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101131:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101138:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.101142:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101150:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101163:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599457.101166:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.101170:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101177:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfaf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101190:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101197:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101228:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101233:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.101237:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101244:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101253:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599457.101255:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.101259:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101265:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfafc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfaee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc46 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101313:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc46 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.101321:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.101323:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599457.101326:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599457.101395:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11381:x1874433559028352:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 737us (962us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787599457.101412:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:2.0:1787599457.104706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.105257:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559028480 00000100:00100000:0.0:1787599457.105269:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559028480 00000100:00100000:0.0:1787599457.105389:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:0.0:1787599457.105401:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11381:x1874433559028480:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1787599457.105466:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105484:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105495:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105529:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105537:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105545:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105552:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599457.105557:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105565:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105577:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.105580:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599457.105598:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.105605:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599457.105698:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11381:x1874433559028480:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 299us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.105706:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1787599457.108491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599457.108582:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559028736 00000100:00100000:3.0:1787599457.108591:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559028736 00000100:00100000:3.0:1787599457.108750:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1787599457.108762:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+53:11381:x1874433559028736:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599457.109426:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11381:x1874433559028736:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 662us (939us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787599457.109436:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1787599457.215042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.215194:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559028992 00000100:00100000:2.0:1787599457.215204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559028992 00000100:00100000:2.0:1787599457.215277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:2.0:1787599457.215289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+54:11391:x1874433559028992:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599457.215315:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.215319:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599457.215347:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfa93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc2a expref: 54 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599457.215381:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599457.215396:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc4d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215498:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215513:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215524:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.215535:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599457.215634:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc4d expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215659:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc4d expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.215668:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.215671:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599457.215674:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759400, rc 0) 00000100:00100000:2.0:1787599457.215750:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+55:11391:x1874433559028992:12345-192.168.202.1@tcp:101:bash.0 Request processed in 462us (718us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787599457.215758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1787599457.222409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.222500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.224702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.225193:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029120 00000100:00100000:2.0:1787599457.225205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029120 00000100:00100000:2.0:1787599457.225327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029376 00000100:00100000:2.0:1787599457.225332:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029376 00000100:00080000:2.0:1787599457.225357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599457.225571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.225589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029248 00000100:00100000:1.0:1787599457.225593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029248 00000100:00100000:1.0:1787599457.225627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 381 00000100:00100000:1.0:1787599457.225637:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559029248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599457.225705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559029248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599457.225713:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 381 00000100:00100000:1.0:1787599457.225778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.226004:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029632 00000100:00100000:0.0:1787599457.226010:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029632 00000100:00100000:0.0:1787599457.226039:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029504 00000100:00100000:0.0:1787599457.226042:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029504 00000100:00100000:0.0:1787599457.226060:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:0.0:1787599457.226068:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559029376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599457.226102:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559029376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.226109:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:0.0:1787599457.226123:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:0.0:1787599457.226130:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559029632:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599457.226154:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559029632:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.226160:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:0.0:1787599457.226174:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:0.0:1787599457.226180:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559029504:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599457.226201:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559029504:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.226237:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:0.0:1787599457.226251:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1787599457.226258:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+55:11391:x1874433559029120:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599457.226274:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599457.226295:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfb2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc54 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226331:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226345:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226356:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226590:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324000/0x5d2988b0929cfb2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 57 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226610:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 56 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.226620:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.226623:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599457.226626:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b381324600, rc 0) 00000100:00100000:0.0:1787599457.226659:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+56:11391:x1874433559029120:12345-192.168.202.1@tcp:101:bash.0 Request processed in 401us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.226666:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00080000:0.0:1787599457.226693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599457.226697:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599457.229175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599457.229254:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559029760 00000100:00100000:3.0:1787599457.229264:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559029760 00000100:00100000:3.0:1787599457.229492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1787599457.229516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+56:2404:x1874433559029760:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599457.229530:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599457.229552:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc4d expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.229569:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:3.0:1787599457.229573:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599457.229626:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+55:2404:x1874433559029760:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 113us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599457.229634:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599457.233232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.233324:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030016 00000100:00100000:0.0:1787599457.233334:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030016 00000100:00100000:0.0:1787599457.233481:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:0.0:1787599457.233492:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+55:11391:x1874433559030016:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1787599457.233544:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599457.233570:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc46 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.233589:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.233593:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599457.233789:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.234188:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.234199:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599457.234261:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1787599457.234287:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fda91f8b reply state 0000000010468832 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.234299:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.234306:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.234309:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599457.234319:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599457.234537:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11391:x1874433559030016:12345-192.168.202.1@tcp:36:bash.0 Request processed in 1045us (1325us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787599457.234546:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000020:00080000:0.0:1787599457.234552:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787599457.238200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599457.238311:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030144 00000100:00100000:3.0:1787599457.238321:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030144 00000100:00100000:3.0:1787599457.238390:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1787599457.238403:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+57:11391:x1874433559030144:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599457.238427:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599457.238447:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfb42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc5b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238538:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238554:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238565:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599457.238596:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787599457.238613:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599457.238633:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfb42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238678:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599457.238688:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:3.0:1787599457.238691:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599457.238694:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599457.239052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11391:x1874433559030144:12345-192.168.202.1@tcp:101:bash.0 Request processed in 649us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599457.239061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1787599457.244080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.244165:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030400 00000100:00100000:1.0:1787599457.244189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030400 00000100:00100000:1.0:1787599457.244254:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1787599457.244264:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+58:11391:x1874433559030400:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1787599457.244494:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11391:x1874433559030400:12345-192.168.202.1@tcp:35:bash.0 Request processed in 231us (431us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787599457.244503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599457.317944:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577979776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599457.318043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599457.318332:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577979776 00000100:00100000:2.0:1787599457.318343:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577979776 00000100:00100000:2.0:1787599457.318460:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787599457.318472:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577979776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599457.318510:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787599457.318571:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577979776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.318579:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787599457.318704:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577979776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599457.332462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.332568:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030528 00000100:00100000:2.0:1787599457.332579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030528 00000100:00100000:2.0:1787599457.332641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1787599457.332652:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:11398:x1874433559030528:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599457.332693:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.332713:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc62 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.332842:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.332858:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.332870:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.332915:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787599457.332919:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599457.332939:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.332964:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc62 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.333059:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc62 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.333069:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599457.333072:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599457.333076:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599457.333145:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559030528:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 495us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.333153:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1787599457.337224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.337331:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030656 00000100:00100000:2.0:1787599457.337343:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030656 00000100:00100000:2.0:1787599457.337504:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:2.0:1787599457.337516:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559030656:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599457.337536:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.337558:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc69 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337619:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337634:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337647:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337659:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337667:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337674:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337764:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337775:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337849:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.337892:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787599457.337897:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599457.337918:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337930:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337939:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337946:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337953:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337959:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.337963:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.337971:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338116:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599457.338120:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.338125:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338145:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfb65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338161:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338167:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338174:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338180:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.338183:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338190:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338198:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599457.338201:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.338204:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338224:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cfb6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338254:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cfb5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338281:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 61 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.338288:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.338291:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599457.338293:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599457.338440:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11398:x1874433559030656:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 925us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.338450:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1787599457.343560:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.343697:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559030912 00000100:00100000:2.0:1787599457.343707:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559030912 00000100:00100000:2.0:1787599457.343781:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1787599457.343832:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11398:x1874433559030912:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599457.343855:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.343875:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc70 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344259:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344276:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344285:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344312:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344346:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344361:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599457.344390:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577979904:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599457.344525:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.344535:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 62 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599457.344546:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577980032:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599457.344574:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599457.347359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1787599457.347750:0:13004:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.1@tcp) returned -22 from blocking AST (req@000000007cfafd03 x1874433577979904) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.347774:0:13004:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.348067:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfb73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc69 expref: 62 pid: 10099 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599457.348101:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577979904:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599457.350306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.350656:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577980032:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599457.350687:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.350693:0:13004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.350706:0:13004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.350716:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599457.351112:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031040 00000100:00100000:0.0:1787599457.351120:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031040 00000100:00100000:0.0:1787599457.351175:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031168 00000100:00100000:0.0:1787599457.351179:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031168 00010000:00010000:0.0:1787599457.351193:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 63 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599457.351227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1787599457.351237:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+63:2403:x1874433559031168:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599457.351253:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599457.351261:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 63 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351275:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 63 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351300:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfb49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc5b expref: 63 pid: 6522 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351336:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.351341:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351349:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351357:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.351387:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599457.351441:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+62:2403:x1874433559031168:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 204us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.351449:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1787599457.351467:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1787599457.351475:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:2403:x1874433559031040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599457.351483:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599457.351486:0:6506:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 5d2988b0929cfb73) 00010000:00010000:0.0:1787599457.351488:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599457.351504:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:2403:x1874433559031040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 30us (4156us total) trans 0 rc 116/116 00000100:00100000:0.0:1787599457.351510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00010000:00010000:2.0:1787599457.351743:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.351752:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.351771:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787599457.351956:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 62 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.351973:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 61 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.351994:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.351997:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599457.352008:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:2.0:1787599457.352045:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11398:x1874433559030912:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 8254us (8495us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787599457.352053:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1787599457.355398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.355480:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031424 00000100:00100000:0.0:1787599457.355490:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031424 00000100:00100000:0.0:1787599457.355556:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599457.355567:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11398:x1874433559031424:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1787599457.355599:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599457.355624:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325c00/0x5d2988b0929cfad2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc3f expref: 61 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.355643:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.355648:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599457.355711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559031424:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 146us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.355720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599457.357895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.358136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031552 00000100:00100000:1.0:1787599457.358147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031552 00000100:00100000:1.0:1787599457.358205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1787599457.358227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559031552:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1787599457.358385:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599457.358404:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599457.358416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599457.358515:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787599457.358684:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559031552:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 457us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599457.358692:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1787599457.363951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.364134:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031680 00000100:00100000:0.0:1787599457.364145:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031680 00000100:00100000:0.0:1787599457.364215:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1787599457.364228:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+60:11398:x1874433559031680:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599457.364249:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599457.364271:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc77 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364334:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364346:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 61 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364366:0:10099:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364389:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 61 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364423:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599457.364426:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599457.364431:0:10099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 61 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.364440:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4400, rc 0) 00000100:00100000:0.0:1787599457.364502:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11398:x1874433559031680:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 276us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.364509:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00010000:00010000:2.0:1787599457.509364:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599457.829263:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599457.829274:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599457.829322:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787599457.829333:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599457.829600:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577980160:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599457.829769:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599457.849650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599457.850440:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031808 00000100:00100000:3.0:1787599457.850454:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031808 00000100:00100000:3.0:1787599457.850528:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1787599457.850540:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559031808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599457.850582:0:13004:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599457.850734:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559031808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 195us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599457.850742:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1787599457.852013:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577980160:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787599457.853921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.854252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559031936 00000100:00100000:2.0:1787599457.854262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559031936 00000100:00100000:2.0:1787599457.854326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1787599457.854338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11399:x1874433559031936:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787599457.854423:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854441:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854467:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854474:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854496:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854523:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854532:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854539:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.854587:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787599457.854592:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599457.854605:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854614:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854621:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854627:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854634:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.854638:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854646:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854664:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599457.854667:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.854672:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854677:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfb9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854691:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854698:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854703:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854709:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.854712:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.854717:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855310:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff96b3778bcc00) 00010000:00010000:2.0:1787599457.855313:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.855317:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855325:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfba4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855356:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855418:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855428:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855433:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.855436:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855443:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855452:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.855455:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599457.855458:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.855465:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599457.855609:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11399:x1874433559031936:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1269us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.855618:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1787599457.865871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.867453:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559032192 00000100:00100000:2.0:1787599457.867467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559032192 00000100:00100000:2.0:1787599457.867536:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1787599457.867561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:11399:x1874433559032192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599457.867581:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.867602:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc7e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867714:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867731:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867742:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.867753:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787599457.867854:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867861:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867867:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867872:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599457.867876:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867883:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867896:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599457.867905:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599457.867910:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867917:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867959:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbb2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc7e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867970:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599457.867972:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599457.867976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc7e expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.867986:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599457.868057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 497us (2195us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787599457.868065:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1787599457.878253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.878431:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559032320 00000100:00100000:2.0:1787599457.878442:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559032320 00000100:00100000:2.0:1787599457.878513:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:2.0:1787599457.878525:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032320:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787599457.878560:0:10099:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787599457.878679:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032320:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 155us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.878687:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1787599457.887331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.888399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559032576 00000100:00100000:2.0:1787599457.888424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559032576 00000100:00100000:2.0:1787599457.888496:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1787599457.888508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599457.888529:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.888532:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599457.888557:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfb57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc62 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.888576:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:2.0:1787599457.888581:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599457.888594:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbc7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc85 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599457.889041:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787599457.889183:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.889196:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.889222:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.889277:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbc7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc85 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.889292:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc85 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.889556:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b3778bcc00) 00010000:00010000:2.0:1787599457.889559:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599457.889562:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599457.889643:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+63:11399:x1874433559032576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1136us (2320us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787599457.889651:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1787599457.894911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.895016:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559032832 00000100:00100000:2.0:1787599457.895028:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559032832 00000100:00100000:0.0:1787599457.895427:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1787599457.895439:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+63:11399:x1874433559032832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599457.895501:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599457.895528:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cfbce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc85 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895547:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b3778bcc00) 00010000:00010000:0.0:1787599457.895558:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599457.895578:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895593:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895620:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895636:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895644:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895649:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895698:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895707:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895715:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895721:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599457.895726:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895733:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895742:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:0.0:1787599457.895745:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599457.895749:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895762:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895772:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895885:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895894:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895900:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599457.895904:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895910:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895919:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x201015bc (ffff96b35acbba00) 00010000:00010000:0.0:1787599457.895922:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599457.895925:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.895931:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbe3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x201015bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599457.896270:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 821us (1358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599457.896279:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:1.0:1787599457.902493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.902675:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559032960 00000100:00100000:0.0:1787599457.902685:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559032960 00000100:00100000:0.0:1787599457.902749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:0.0:1787599457.902760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+62:11399:x1874433559032960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599457.902782:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599457.902853:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc8c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.902905:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.902919:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.902929:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.903060:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.903078:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.903087:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599457.903090:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599457.903094:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4200, rc 0) 00000100:00100000:0.0:1787599457.903155:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+63:11399:x1874433559032960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 396us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.903163:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1787599457.911463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.911869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559033216 00000100:00100000:2.0:1787599457.911879:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559033216 00000100:00100000:2.0:1787599457.911975:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:2.0:1787599457.911988:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+63:11399:x1874433559033216:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599457.912074:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.912102:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.912116:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599457.912316:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787599457.912326:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404531533274ns, next at 405531530664ns, rc = 0 00000004:00010000:2.0:1787599457.912387:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000975781f3 reply state 000000009122641f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.912401:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.912424:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:2.0:1787599457.912427:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787599457.912431:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599457.912533:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+65:11399:x1874433559033216:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 547us (1080us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787599457.912540:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:1.0:1787599457.933918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.934022:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559033344 00000100:00100000:0.0:1787599457.934034:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559033344 00000100:00100000:0.0:1787599457.934101:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1787599457.934111:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+65:11399:x1874433559033344:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599457.934145:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599457.934166:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc93 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.934233:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.934250:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.934279:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599457.934283:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599457.934287:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5c00, rc 0) 00000100:00100000:0.0:1787599457.934357:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+66:11399:x1874433559033344:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 246us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.934883:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:1.0:1787599457.940407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.940666:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559033472 00000100:00100000:0.0:1787599457.940680:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559033472 00000100:00100000:0.0:1787599457.940761:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1787599457.940772:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559033472:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787599457.941034:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559033472:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 263us (638us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787599457.941043:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00080000:2.0:1787599457.941642:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599457.944969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.945078:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559033728 00000100:00100000:1.0:1787599457.945099:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559033728 00000100:00100000:1.0:1787599457.945175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1787599457.945188:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+66:11399:x1874433559033728:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599457.945463:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+67:11399:x1874433559033728:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 277us (504us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787599457.945470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1787599457.948531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.953619:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559033984 00000100:00100000:2.0:1787599457.953636:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559033984 00000100:00100000:2.0:1787599457.953714:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1787599457.953725:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+67:11399:x1874433559033984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787599457.953887:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+67:11399:x1874433559033984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 164us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.953895:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1787599457.963912:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599457.964013:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034112 00000100:00100000:2.0:1787599457.964022:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034112 00000100:00100000:2.0:1787599457.964080:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1787599457.964101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+67:11399:x1874433559034112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599457.964123:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599457.964145:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfc06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbc9a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964240:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964257:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964287:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599457.964341:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599457.964360:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964562:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfc06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc9a expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964582:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc9a expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599457.964591:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:2.0:1787599457.964594:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787599457.964598:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759800, rc 0) 00000100:00100000:2.0:1787599457.964660:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+68:11399:x1874433559034112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 561us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599457.964668:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1787599457.975454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599457.975624:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034240 00000100:00100000:0.0:1787599457.975636:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034240 00000100:00100000:0.0:1787599457.975705:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1787599457.975716:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559034240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599457.975737:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599457.975760:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbca1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599457.975785:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a61, blocks: 0x0 00010000:00010000:0.0:1787599457.975843:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1787599457.975849:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599457.975859:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.975876:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599457.975890:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5000, rc 0) 00000100:00100000:0.0:1787599457.975944:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559034240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 229us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599457.975951:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1787599457.998018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599457.999380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034496 00000100:00100000:1.0:1787599457.999398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034496 00000100:00100000:1.0:1787599457.999493:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1787599457.999507:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+68:11399:x1874433559034496:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599457.999661:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+68:11399:x1874433559034496:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 157us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599457.999669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1787599458.018120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.018406:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034624 00000100:00100000:0.0:1787599458.018417:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034624 00000100:00100000:0.0:1787599458.018477:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1787599458.018487:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+10:11399:x1874433559034624:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599458.018525:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599458.018544:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbca8 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.018578:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.018587:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599458.018591:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599458.018596:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.018633:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.018648:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.018664:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577980288:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599458.018777:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.029855:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577980288:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599458.029891:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.029913:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4800, rc 0) 00000100:00100000:0.0:1787599458.030002:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+11:11399:x1874433559034624:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 11515us (11893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.030012:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1787599458.036377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.036469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034752 00000100:00100000:0.0:1787599458.036481:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034752 00010000:00010000:0.0:1787599458.036528:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.036577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1787599458.036587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2403:x1874433559034752:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599458.036635:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599458.036665:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.036679:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.036706:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440a9679/0x5d2988b0929cfc14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca1 expref: 11 pid: 8435 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.036725:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599458.036729:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599458.036739:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 10 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.036750:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 10 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.036860:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 10 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.036877:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874433577980416:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599458.036965:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.039879:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1874433577980416:192.168.202.1@tcp:105: 00010000:00010000:0.0:1787599458.039913:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599458.039986:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559034752:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3400us (3620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.039997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1787599458.041232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.041440:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559034880 00000100:00100000:2.0:1787599458.041450:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559034880 00002000:00100000:2.0:1787599458.041499:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff96b37fa06d80 x1874433559034880/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:314/0 lens 504/0 e 0 to 0 dl 1787599469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599458.041509:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b37fa06d80 with x1874433559034880 ext(0->12) 00002000:00010000:2.0:1787599458.041515:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b37fa06d80 00000100:00100000:2.0:1787599458.041549:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1787599458.041559:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559034880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787599458.044561:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+12:2403:x1874433559034880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 2990us (3321us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787599458.044577:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:2.0:1787599458.044591:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff96b37fa06d80 x1874433559034880/t4294967309(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:314/0 lens 504/448 e 0 to 0 dl 1787599469 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599458.044601:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b37fa06d80 with x1874433559034880 ext(0->12) 00002000:00010000:2.0:1787599458.044607:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b37fa06d80 00000100:00100000:3.0:1787599458.059402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.060406:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035008 00000100:00100000:0.0:1787599458.060424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035008 00000100:00100000:0.0:1787599458.060531:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1787599458.060544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+68:11399:x1874433559035008:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1787599458.060721:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787599458.065548:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787599458.065570:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787599458.065622:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787599458.065647:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b242390840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787599458.065653:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34629e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b242390600 00000020:00080000:1.0:1787599458.065657:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34629e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b377afbe00 00000004:00080000:1.0:1787599458.065685:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787599458.065715:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b244066d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787599458.065729:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34ee47d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b244066c00 00000020:00080000:1.0:1787599458.065753:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34ee47500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b2435a8e00 00000100:00100000:3.0:1787599458.066226:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599458.066253:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577980544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787599458.066353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599458.066419:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577980544 00000100:00100000:3.0:1787599458.066428:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577980544 00000100:00100000:3.0:1787599458.066488:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599458.066500:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1874433577980544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787599458.066531:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787599458.066565:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c9a60, atime: 0x6a8c9a61, ctime: 0x6a8c9a60, blocks: 0x8 00010000:00010000:3.0:1787599458.066574:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066593:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1787599458.066597:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599458.066604:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066621:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066633:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066654:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066673:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599458.066868:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3648:x1874433577980544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 370us (514us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787599458.066876:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787599458.066900:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599458.066906:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066915:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599458.066920:0:10398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066931:0:10398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066949:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.066957:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d73427/0x5d2988b0929cfc22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787599458.067315:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787599458.067353:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787599458.067367:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577980800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787599458.067401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599458.067441:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577980800 00000100:00100000:0.0:1787599458.067446:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577980800 00000100:00100000:0.0:1787599458.067480:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599458.067488:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577980800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787599458.067565:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787599458.067577:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787599458 00002000:00010000:0.0:1787599458.067580:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787599458.067582:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787599457 -> 1787599458 00002000:00010000:0.0:1787599458.067585:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787599458.067618:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1874433577980800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (216us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787599458.067625:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1787599458.067665:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b37fa07800/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787599458.067672:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577980800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787599458.067779:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11399:x1874433559035008:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 7236us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.067788:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1787599458.068131:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599458.068142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577980672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787599458.068175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599458.068354:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599458.068366:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599458.068368:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787599458.068394:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b24347a680/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787599458.068401:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577980544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787599458.068417:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577980672 00000100:00100000:3.0:1787599458.068422:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577980672 00000100:00100000:3.0:1787599458.068695:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787599458.068705:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1874433577980672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787599458.068725:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1787599458.068745:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.068763:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.068770:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787599458.068774:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599458.068778:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.068836:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.068849:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 11 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599458.068861:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577980928:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599458.068923:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f600 going to sleep for 11 seconds 00010000:00010000:2.0:1787599458.072184:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072279:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072287:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072293:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072298:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072306:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072326:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96b242d00900) 00010000:00010000:2.0:1787599458.072328:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.072334:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072365:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325600/0x5d2988b0929cf920 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072469:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072476:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072481:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072486:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072489:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072494:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072502:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96b370675100) 00010000:00010000:2.0:1787599458.072504:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.072507:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072512:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cf9c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072528:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072534:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072548:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072554:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072556:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072562:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072570:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599458.072572:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.072575:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072580:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfa46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072591:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072597:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072603:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072607:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072609:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072625:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072634:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b342bf1000) 00010000:00010000:2.0:1787599458.072636:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.072638:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072644:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfa69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072658:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072665:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072670:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072674:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072677:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072682:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072689:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599458.072691:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.072694:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072706:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfb3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072718:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072738:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072744:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072749:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.072753:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072759:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072768:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:2.0:1787599458.072771:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599458.072773:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.072779:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfbf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787599458.078599:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599458.078612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599458.079769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.080113:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577980928:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599458.080141:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.080270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.080295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035264 00000100:00100000:2.0:1787599458.080302:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035264 00010000:00010000:2.0:1787599458.080341:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 12 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.080378:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1787599458.080388:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+12:2404:x1874433559035264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599458.080401:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599458.080407:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 12 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080421:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 12 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080445:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc707ef/0x5d2988b0929cf9d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc00 expref: 12 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080461:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599458.080465:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599458.080471:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080480:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080508:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599458.080553:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2404:x1874433559035264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 166us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599458.080560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00010000:00010000:2.0:1787599458.080607:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080615:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080625:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080633:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.080648:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599458.080832:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3647:x1874433577980672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12128us (12657us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787599458.080841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599458.080854:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035136 00000100:00100000:2.0:1787599458.080857:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035136 00010000:00010000:3.0:1787599458.081226:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599458.081233:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.081242:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599458.081246:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.081256:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.081271:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.081278:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cfc29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.081293:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599458.081295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599458.081297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787599458.081333:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b37fa07480/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787599458.081341:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577980672:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787599458.090669:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787599458.090694:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787599458.093730:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1787599458.093758:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2406:x1874433559035136:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787599458.100961:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787599458.100996:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787599458.101174:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433559035136:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 7424us (21405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.101186:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599458.106297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.106530:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035520 00000100:00100000:0.0:1787599458.106541:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035520 00000100:00100000:0.0:1787599458.106606:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1787599458.106617:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11399:x1874433559035520:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599458.106676:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599458.106707:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfc0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc9a expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.106746:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599458.106751:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599458.106787:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.106852:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.106862:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599458.106979:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098f481d2 reply state 000000003befa72a transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.106992:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.106997:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599458.107000:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599458.107003:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599458.107108:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11399:x1874433559035520:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 492us (823us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787599458.107116:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1787599458.113968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.114311:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035648 00000100:00100000:0.0:1787599458.114322:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035648 00000100:00100000:0.0:1787599458.114386:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1787599458.114397:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559035648:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787599458.114558:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787599458.114569:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787599458 -> 1787599457 00002000:00010000:0.0:1787599458.114571:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787599457 00002000:00010000:0.0:1787599458.114573:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787599458 -> 1787599457 00002000:00010000:0.0:1787599458.114575:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787599458.114645:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559035648:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 249us (689us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787599458.114652:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599458.127591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.128176:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559035904 00000100:00100000:2.0:1787599458.128188:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559035904 00000100:00100000:2.0:1787599458.128266:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:2.0:1787599458.128277:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+17:11399:x1874433559035904:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787599458.128838:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.128858:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.128868:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.128964:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.128980:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 17 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.128996:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577981056:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599458.129220:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599458.140131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.141904:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036032 00000100:00100000:0.0:1787599458.141920:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036032 00010000:00010000:0.0:1787599458.141978:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 18 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.142041:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1787599458.142053:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:2404:x1874433559036032:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599458.142079:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599458.142087:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 18 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.142100:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 18 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.142124:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599458.142130:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.142141:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.142169:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.142189:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599458.142278:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+18:2404:x1874433559036032:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 227us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.142286:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00010000:00010000:2.0:1787599458.144381:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfbf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc8c expref: 17 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.144416:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577981056:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599458.144442:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.144847:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.144855:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145165:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145172:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145179:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145185:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.145190:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145198:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145227:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:2.0:1787599458.145230:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787599458.145235:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.145240:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.145336:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11399:x1874433559035904:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 17058us (17752us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787599458.145346:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:3.0:1787599458.148009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.148168:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036160 00000100:00100000:0.0:1787599458.148179:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036160 00000100:00100000:0.0:1787599458.148291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1787599458.148302:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559036160:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787599458.148343:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.148365:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.148373:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599458.148378:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599458.148383:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.148420:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.148435:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 7 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.148469:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874433577981184:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599458.148551:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599458.153916:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874433577981184:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599458.153949:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599458.158052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.158150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036288 00000100:00100000:2.0:1787599458.158161:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036288 00010000:00010000:2.0:1787599458.158214:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 8 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.158278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1787599458.158290:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559036288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599458.158306:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599458.158327:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 8 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.158341:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 8 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.158365:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929cfc1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbca8 expref: 8 pid: 8629 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.158384:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599458.158389:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599458.158395:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.158405:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.158439:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599458.158497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559036288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 210us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599458.158505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00010000:00010000:1.0:1787599458.158574:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158585:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158606:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158614:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158622:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158642:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599458.158646:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158655:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158670:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.158678:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929cfc3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599458.158741:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433559036160:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 10440us (10742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599458.158749:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1787599458.171005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.171167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036544 00000100:00100000:0.0:1787599458.171178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036544 00000100:00100000:0.0:1787599458.171252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1787599458.171377:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+16:11399:x1874433559036544:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787599458.171461:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.171481:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 16 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.171492:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.171530:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 16 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.171543:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 16 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.171556:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981312:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599458.171644:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.173676:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981312:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599458.173709:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599458.174576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599458.180129:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036672 00000100:00100000:1.0:1787599458.180147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036672 00010000:00010000:1.0:1787599458.180214:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599458.180335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1787599458.180346:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+17:2404:x1874433559036672:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599458.180374:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599458.180382:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180411:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180435:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324600/0x5d2988b0929cfb34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc54 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180454:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599458.180461:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 16 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180471:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180480:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180487:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.180522:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599458.180661:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180670:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180887:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180899:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180908:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180938:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.180951:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.180966:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981440:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599458.181440:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+17:2404:x1874433559036672:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1092us (6866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599458.181451:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1787599458.181624:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.188849:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981440:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599458.188892:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599458.190533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.190619:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036800 00000100:00100000:0.0:1787599458.190644:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036800 00010000:00010000:0.0:1787599458.190687:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599458.190744:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1787599458.190756:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+17:2403:x1874433559036800:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599458.190775:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599458.190782:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.190824:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.190849:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfbff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc93 expref: 17 pid: 10099 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.190865:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599458.190871:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.191209:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.191218:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.191253:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599458.191350:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.191359:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599458.191485:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787599458.191603:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787599458.191639:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787599458.191736:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577981568:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787599458.191851:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599458.192253:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.192472:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:2403:x1874433559036800:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1715us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.192499:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1787599458.192585:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577981568 00000100:00100000:3.0:1787599458.192593:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577981568 00000100:00100000:3.0:1787599458.192642:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787599458.192653:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577981568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787599458.192760:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577981568:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599458.192768:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787599458.193005:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787599458.193011:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1787599458.193035:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b37fa07800, transno 4294967310 00000004:00080000:2.0:1787599458.193492:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b37fa07480, transno 4294967311 00000100:00100000:2.0:1787599458.193503:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577981568:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787599458.193650:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787599458.193729:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577981696:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787599458.193781:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599458.193854:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599458.195889:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577981696 00000100:00100000:0.0:1787599458.195904:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577981696 00000100:00100000:0.0:1787599458.195962:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787599458.195972:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577981696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787599458.196168:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1874433577981696:12345-0@lo:1000:mdt00_001.0 Request processed in 197us (2386us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787599458.196176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787599458.196543:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577981696:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787599458.196597:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196609:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196617:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196639:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.196644:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196652:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196671:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:2.0:1787599458.196675:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599458.196680:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196687:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfc4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196714:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196734:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196741:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196746:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.196750:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196756:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196777:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599458.196779:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599458.196787:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196828:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.196839:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.197216:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 19 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.197235:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981824:192.168.202.1@tcp:105: 00000100:00100000:2.0:1787599458.197497:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599458.222915:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.223112:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577981824:192.168.202.1@tcp:105: 00010000:00010000:2.0:1787599458.223146:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfb8f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223194:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223218:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223251:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223262:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223268:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223274:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223280:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.223284:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223291:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599458.223304:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599458.223308:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223313:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223322:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223328:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223339:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223344:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599458.223347:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223353:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223370:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599458.223373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787599458.223376:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.223382:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfc45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.223562:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11399:x1874433559036544:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 52300us (52566us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787599458.223572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000020:00080000:2.0:1787599458.223578:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787599458.223675:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559036928 00000100:00100000:1.0:1787599458.223684:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559036928 00000100:00100000:1.0:1787599458.223738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1787599458.223748:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11398:x1874433559036928:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:1.0:1787599458.223895:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11398:x1874433559036928:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 147us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599458.223901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000040:00080000:0.0:1787599458.224172:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599458.224176:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599458.224676:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787599458.224687:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599458.233309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.233384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.233528:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559037440 00000100:00100000:2.0:1787599458.233540:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559037440 00000100:00100000:2.0:1787599458.233600:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1787599458.233611:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:11398:x1874433559037440:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:2.0:1787599458.233848:0:10099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787599458.234082:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559037184 00000100:00100000:1.0:1787599458.234089:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559037184 00000100:00100000:1.0:1787599458.234121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1787599458.234128:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:11399:x1874433559037184:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787599458.235008:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787599458.235041:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1787599458.235082:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235100:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235110:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235118:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235124:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235130:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.235158:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787599458.235269:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11399:x1874433559037184:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1130us (1958us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787599458.235301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000020:00080000:1.0:1787599458.235306:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787599458.235369:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+21:11398:x1874433559037440:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1758us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599458.235387:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00010000:00010000:0.0:1787599458.237002:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599458.237017:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.237029:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599458.237033:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.237043:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.237061:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599458.237065:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787599458.237069:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.237089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfc5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.237108:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599458.237110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599458.237112:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599458.306430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599458.306466:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559037568 00000100:00100000:2.0:1787599458.306480:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559037568 00000100:00100000:2.0:1787599458.306556:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:2.0:1787599458.306568:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+21:11401:x1874433559037568:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599458.306599:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599458.306622:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcaf expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.306699:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.307190:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599458.307216:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307289:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307299:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307307:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307424:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307436:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 22 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307463:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307501:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 22 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599458.307516:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 22 pid: 13004 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599458.307531:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577981952:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599458.307628:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599458.323304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599458.323527:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577981952:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599458.323555:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599458.323823:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559037824 00000100:00100000:2.0:1787599458.323833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559037824 00000100:00100000:2.0:1787599458.323909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1787599458.323919:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:6175:x1874433559037824:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787599458.324165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+24:6175:x1874433559037824:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 246us (870us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787599458.324173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1787599458.331066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599458.331386:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559037952 00000100:00100000:1.0:1787599458.331399:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559037952 00010000:00010000:1.0:1787599458.331451:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 24 pid: 13004 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599458.331499:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1787599458.331510:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+24:2403:x1874433559037952:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599458.331526:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599458.331533:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 24 pid: 13004 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331547:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 24 pid: 13004 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331583:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfb81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc70 expref: 24 pid: 13004 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331603:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599458.331608:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331617:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331624:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599458.331672:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599458.331741:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+23:2403:x1874433559037952:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 232us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599458.331749:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:0.0:1787599458.332317:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332331:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599458.332418:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787599458.332424:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599458.332450:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332466:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332476:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332482:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332506:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332512:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599458.332516:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332524:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332538:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:0.0:1787599458.332541:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599458.332545:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332550:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfc68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332566:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332572:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332577:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332582:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599458.332585:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332599:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332607:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96b3778bcb00) 00010000:00010000:0.0:1787599458.332610:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599458.332612:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332617:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfc6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332661:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfc61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcaf expref: 23 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332674:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcaf expref: 22 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599458.332681:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:0.0:1787599458.332683:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599458.332685:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ce00, rc 0) 00000100:00100000:0.0:1787599458.332890:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11401:x1874433559037568:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 26323us (26470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599458.332899:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00010000:00010000:3.0:1787599458.533004:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599459.241255:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599459.241265:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599459.241291:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787599459.241301:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599459.241548:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577982080:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599459.241697:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b35ac73480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599459.262258:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577982080:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599459.277393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599459.281885:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559038080 00000100:00100000:0.0:1787599459.281905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559038080 00000100:00100000:0.0:1787599459.285819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1787599459.285841:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11413:x1874433559038080:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599459.285886:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599459.286031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11413:x1874433559038080:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 198us (8648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.286041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:3.0:1787599459.288762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599459.288916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559038336 00000100:00100000:2.0:1787599459.288934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559038336 00000100:00100000:2.0:1787599459.290178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:2.0:1787599459.290206:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+22:11413:x1874433559038336:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599459.290229:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599459.290249:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfc7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcb6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.290360:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfc84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.290375:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.290387:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599459.290399:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787599459.290513:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfc7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcb6 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.290528:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfc84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcb6 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.290536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599459.290540:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599459.290543:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758c00, rc 0) 00000100:00100000:2.0:1787599459.290605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+24:11413:x1874433559038336:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 416us (1853us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787599459.290612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:3.0:1787599459.299276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599459.299324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599459.299380:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559038592 00000100:00100000:1.0:1787599459.299391:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559038592 00000100:00100000:1.0:1787599459.299458:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1787599459.299470:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+24:11413:x1874433559038592:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787599459.299556:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299575:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299587:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299733:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299741:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299749:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299755:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599459.299760:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299785:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299823:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599459.299826:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599459.299831:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.299837:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfc92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599459.299953:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+25:11413:x1874433559038592:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 484us (688us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787599459.299962:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1787599459.300849:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559038720 00000100:00100000:2.0:1787599459.300859:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559038720 00000100:00100000:2.0:1787599459.300910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1787599459.300920:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+25:2403:x1874433559038720:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599459.300933:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599459.300952:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758c00/0x5d2988b0929cfc84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcb6 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.300966:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:2.0:1787599459.300971:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599459.301009:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+24:2403:x1874433559038720:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 91us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599459.301016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000040:00080000:0.0:1787599459.301859:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599459.301865:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599459.302562:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787599459.302574:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599459.310254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599459.310329:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559038976 00000100:00100000:0.0:1787599459.310340:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559038976 00000100:00100000:0.0:1787599459.310410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1787599459.310421:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+24:11413:x1874433559038976:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599459.310634:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:11413:x1874433559038976:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 214us (390us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787599459.310641:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1787599459.365029:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577982464:0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.365094:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577982336:0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.365112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599459.365141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599459.365177:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577982848:0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.365186:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577982976:0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.365219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599459.365234:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599459.365245:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577983360:0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.365258:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577983488:0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.365275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599459.365294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599459.365298:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577983872:0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.365325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599459.365367:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983360 00000100:00100000:3.0:1787599459.365372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982336 00000100:00100000:1.0:1787599459.365377:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983360 00000100:00100000:3.0:1787599459.365392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982336 00000100:00100000:1.0:1787599459.365429:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983872 00000100:00100000:1.0:1787599459.365433:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983872 00000100:00100000:1.0:1787599459.365459:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787599459.365468:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577983360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.365525:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577983360:12345-0@lo:400:kworker.0 Request processed in 58us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599459.365540:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787599459.365558:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787599459.365564:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577983872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.365597:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577983872:12345-0@lo:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599459.365603:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787599459.365663:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787599459.365672:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577982336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.365706:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577982336:12345-0@lo:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599459.365712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787599459.365752:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982848 00000100:00100000:3.0:1787599459.365756:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982848 00000100:00100000:2.0:1787599459.365930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577982592:0@lo:400:kworker.0 00000100:00100000:2.0:1787599459.365963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599459.366039:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577984000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599459.366047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577982208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599459.366068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.366087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.366115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577982720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.366172:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577983232:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.366224:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577983744:0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.366238:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982464 00000100:00100000:1.0:1787599459.366244:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982464 00000100:00100000:0.0:1787599459.366248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599459.366277:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982976 00000100:00100000:1.0:1787599459.366281:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982976 00000100:00100000:0.0:1787599459.366285:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983488 00000100:00100000:0.0:1787599459.366291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983488 00000100:00100000:1.0:1787599459.366308:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982720 00000100:00100000:1.0:1787599459.366313:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982720 00000100:00100000:0.0:1787599459.366325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787599459.366334:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577982464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.366341:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787599459.366351:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577982976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366381:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433577982464:12345-0@lo:400:kworker.0 Request processed in 48us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787599459.366406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787599459.366413:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577983488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.366422:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433577982976:12345-0@lo:400:kworker.0 Request processed in 72us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599459.366429:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787599459.366449:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433577983488:12345-0@lo:400:kworker.0 Request processed in 35us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599459.366450:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787599459.366461:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577982720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787599459.366485:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983232 00000100:00100000:0.0:1787599459.366491:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983232 00000100:00100000:1.0:1787599459.366507:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577982720:12345-0@lo:400:kworker.0 Request processed in 48us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983744 00000100:00100000:0.0:1787599459.366514:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983744 00000100:00100000:1.0:1787599459.366517:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787599459.366535:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787599459.366543:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577983232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366580:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577983232:12345-0@lo:400:kworker.0 Request processed in 38us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366586:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787599459.366597:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787599459.366603:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577983744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366637:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577983744:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366644:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787599459.366675:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984000 00000100:00100000:0.0:1787599459.366679:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984000 00000100:00100000:0.0:1787599459.366700:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982208 00000100:00100000:0.0:1787599459.366702:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982208 00000100:00100000:0.0:1787599459.366715:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787599459.366720:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577984000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599459.366734:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787599459.366764:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577984000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366770:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787599459.366782:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787599459.366788:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577982208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599459.366817:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787599459.366840:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577982208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.366846:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1787599459.366862:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599459.366867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599459.366869:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599459.366905:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577984000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599459.366917:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433577982976:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366927:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433577983488:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.366938:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433577982464:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367010:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577982208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599459.367021:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577982720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367029:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577983232:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367037:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577983744:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367089:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577982336:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367099:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577983360:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.367108:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787599459.367114:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1787599459.367129:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2434ea680, transno 4294967302 00000004:00080000:0.0:1787599459.367138:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1787599459.367148:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b24347a680, transno 4294967305 00000100:00100000:0.0:1787599459.367152:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577983872:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.370287:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577983104:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.370357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.370509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577983616:0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.370531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.370575:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983104 00000100:00100000:0.0:1787599459.370583:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983104 00000100:00100000:0.0:1787599459.370630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577983616 00000100:00100000:0.0:1787599459.370633:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577983616 00000100:00100000:0.0:1787599459.370655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787599459.370664:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577983104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.371052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577983104:12345-0@lo:400:kworker.0 Request processed in 388us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.371068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787599459.371458:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577982592 00000100:00100000:3.0:1787599459.371465:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577982592 00000100:00100000:0.0:1787599459.371473:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787599459.371483:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577983616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.371500:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787599459.371511:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577982848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.371527:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577983616:12345-0@lo:400:kworker.0 Request processed in 45us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.371534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1787599459.371561:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599459.371571:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577982848:12345-0@lo:400:kworker.0 Request processed in 63us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599459.371579:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787599459.371595:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00010000:00080000:0.0:1787599459.371600:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419bf100 x1874433577983104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599459.371604:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577982592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599459.371623:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577983104:0@lo:400:kworker.0 00010000:00080000:0.0:1787599459.371637:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2436ff800 x1874433577983616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599459.371647:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577983616:0@lo:400:kworker.0 00000100:00100000:3.0:1787599459.371937:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577982592:12345-0@lo:400:kworker.0 Request processed in 335us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599459.371944:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787599459.371977:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577982848:0@lo:400:kworker.0 00000100:00100000:1.0:1787599459.372060:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577982592:0@lo:400:kworker.0 00010000:00010000:2.0:1787599459.557208:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599459.617788:0:14265:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599459.617816:0:14265:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599459.617846:0:14265:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787599459.617852:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599459.819275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599459.819656:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039232 00000100:00100000:3.0:1787599459.819667:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039232 00000100:00100000:3.0:1787599459.819723:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:3.0:1787599459.819733:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+25:11426:x1874433559039232:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599459.819767:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599459.819788:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfc99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcbd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.819915:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cfca0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.819929:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cfca0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.819940:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cfca0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599459.819950:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787599459.820057:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfc99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcbd expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.820075:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cfca0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcbd expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.820084:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:3.0:1787599459.820087:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787599459.820090:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d600, rc 0) 00000100:00100000:3.0:1787599459.820157:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+27:11426:x1874433559039232:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 425us (891us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787599459.820164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:1.0:1787599459.832779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599459.832855:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039360 00000100:00100000:1.0:1787599459.832868:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039360 00000100:00100000:1.0:1787599459.832921:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1787599459.832931:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+27:11426:x1874433559039360:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1787599459.833003:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833021:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833032:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833066:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833073:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833079:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833084:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599459.833088:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833095:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833106:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599459.833110:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599459.833120:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599459.833126:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599459.833494:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+27:11426:x1874433559039360:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 563us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599459.833502:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:3.0:1787599459.877380:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599459.877404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577984128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599459.877575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599459.877868:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984128 00000100:00100000:3.0:1787599459.877877:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984128 00000100:00100000:3.0:1787599459.877927:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787599459.877938:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577984128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599459.877970:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599459.878037:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577984128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599459.878043:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787599459.878090:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577984128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599459.879233:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599459.879249:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577984256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599459.879306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599459.884557:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984256 00000100:00100000:0.0:1787599459.884576:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984256 00000100:00100000:0.0:1787599459.884659:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787599459.884679:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577984256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599459.884707:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599459.884817:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577984256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.884825:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787599459.885000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577984256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599459.931669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599459.931936:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039488 00000100:00100000:0.0:1787599459.931951:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039488 00000100:00100000:0.0:1787599459.932056:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1787599459.932069:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559039488:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1787599459.932094:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599459.932119:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929cfcb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcc4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599459.932146:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c9a61, atime: 0x6a8c9a61, ctime: 0x6a8c9a61, blocks: 0x8 00010000:00010000:0.0:1787599459.932167:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787599459.932171:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599459.932181:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929cfcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcc4 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.932232:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929cfcb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcc4 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.932247:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5e00, rc 0) 00000100:00100000:0.0:1787599459.932320:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559039488:12345-192.168.202.1@tcp:101:cat.0 Request processed in 253us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599459.932328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00080000:2.0:1787599459.932778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599459.936656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599459.939865:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039616 00000100:00100000:1.0:1787599459.939879:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039616 00002000:00100000:1.0:1787599459.939942:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff96b24375fb80 x1874433559039616/t0(0) o3->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:315/0 lens 488/0 e 0 to 0 dl 1787599470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599459.939954:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b24375fb80 with x1874433559039616 ext(0->4095) 00002000:00010000:1.0:1787599459.939960:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b24375fb80 00000100:00100000:1.0:1787599459.939988:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1787599459.939997:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559039616:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:1.0:1787599459.941162:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559039616:12345-192.168.202.1@tcp:3:cat.0 Request processed in 1159us (4509us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787599459.941172:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:1.0:1787599459.941181:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff96b24375fb80 x1874433559039616/t0(0) o3->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:315/0 lens 488/4536 e 0 to 0 dl 1787599470 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599459.941223:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b24375fb80 with x1874433559039616 ext(0->4095) 00002000:00010000:1.0:1787599459.941229:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b24375fb80 00010000:00010000:3.0:1787599460.581026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599460.902419:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577984384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599460.902495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599460.902568:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984384 00000100:00100000:3.0:1787599460.902576:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984384 00000100:00100000:3.0:1787599460.902616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599460.902624:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577984384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599460.902657:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787599460.902701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577984384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599460.902708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599460.902751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577984384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599461.609617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599462.345221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599462.345493:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040000 00000100:00100000:3.0:1787599462.345507:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040000 00000100:00100000:3.0:1787599462.345590:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039872 00000100:00100000:3.0:1787599462.345593:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039872 00000100:00100000:3.0:1787599462.345614:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040512 00000100:00100000:3.0:1787599462.345617:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040512 00000100:00100000:3.0:1787599462.345632:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040384 00000100:00100000:3.0:1787599462.345635:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040384 00000100:00100000:3.0:1787599462.345653:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:3.0:1787599462.345664:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559040000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.345757:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559040000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.345765:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:3.0:1787599462.345784:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:3.0:1787599462.345827:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+27:2405:x1874433559039872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.345858:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+27:2405:x1874433559039872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.345865:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:3.0:1787599462.345879:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:3.0:1787599462.345885:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559040512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.345906:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559040512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.345911:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:3.0:1787599462.345931:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:3.0:1787599462.345937:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559040384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.345962:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559040384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.345967:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:3.0:1787599462.345990:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040256 00000100:00100000:3.0:1787599462.345994:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040256 00000100:00100000:3.0:1787599462.346021:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040128 00000100:00100000:3.0:1787599462.346024:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040128 00000100:00100000:3.0:1787599462.346042:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1787599462.346049:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559040256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.346074:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559040256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.346081:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1787599462.346092:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1787599462.346098:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559040128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599462.346122:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559040128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.346129:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00080000:3.0:1787599462.346155:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599462.346160:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599462.346176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599462.346179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599462.346502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559039744 00000100:00100000:1.0:1787599462.346509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559039744 00000100:00100000:1.0:1787599462.346689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 383 00000100:00100000:1.0:1787599462.346699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559039744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599462.346741:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559039744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599462.346748:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 383 00000040:00080000:2.0:1787599462.375852:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599462.375863:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599462.375887:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787599462.375897:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599462.445631:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577984512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599462.445713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599462.445879:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984512 00000100:00100000:3.0:1787599462.445887:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984512 00000100:00100000:3.0:1787599462.445998:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787599462.446008:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577984512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599462.446076:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787599462.446144:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577984512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599462.446152:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787599462.446257:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577984512:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787599462.509456:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599462.630048:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599463.465054:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787599463.465104:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b244066e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787599463.465110:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b347e0b000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b2440660c0 00000020:00080000:1.0:1787599463.465113:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b347e0b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b243552a00 00010000:00010000:0.0:1787599463.465115:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465127:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465144:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465150:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599463.465165:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465173:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465193:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96b35acbba00) 00010000:00010000:0.0:1787599463.465196:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599463.465201:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599463.465208:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfc30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787599463.465254:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787599463.466265:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787599463.466356:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787599463.653083:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599464.485098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577984640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599464.485184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.485265:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984640 00000100:00100000:0.0:1787599464.485272:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984640 00000100:00100000:0.0:1787599464.485335:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787599464.485346:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577984640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599464.485377:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787599464.485432:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577984640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.485440:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787599464.485466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599464.485502:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577984640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599464.486236:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577984896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.486279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486307:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577985408:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.486332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486349:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577985920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.486372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486733:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787599464.486741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577985024:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.486780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486824:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577985536:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.486850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486871:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577986048:0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.486880:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985920 00000100:00100000:3.0:1787599464.486888:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985920 00000100:00100000:0.0:1787599464.486893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.486929:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984896 00000100:00100000:0.0:1787599464.486934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984896 00000100:00100000:3.0:1787599464.486940:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985024 00000100:00100000:3.0:1787599464.486945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985024 00000100:00100000:3.0:1787599464.486966:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985536 00000100:00100000:3.0:1787599464.486970:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985536 00000100:00100000:0.0:1787599464.486974:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787599464.486985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.486991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986048 00000100:00100000:3.0:1787599464.486996:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986048 00000100:00100000:3.0:1787599464.487017:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787599464.487026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577985920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.487035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577984896:12345-0@lo:400:kworker.0 Request processed in 51us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.487043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787599464.487076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577985920:12345-0@lo:400:kworker.0 Request processed in 51us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.487079:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985408 00000100:00100000:0.0:1787599464.487085:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985408 00000100:00100000:3.0:1787599464.487088:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787599464.487108:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787599464.487117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577985024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.487122:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787599464.487134:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577985408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.487164:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577985024:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.487178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787599464.487195:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787599464.487204:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577985536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.487212:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577985408:12345-0@lo:400:kworker.0 Request processed in 79us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.487220:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787599464.487242:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787599464.487252:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577986048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.487258:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577985536:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.487267:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787599464.487291:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b343044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577986048:12345-0@lo:400:kworker.0 Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.487298:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787599464.487338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577984768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599464.487366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599464.487582:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577984768 00000100:00100000:3.0:1787599464.487586:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577984768 00000100:00100000:3.0:1787599464.487615:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787599464.487622:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577984768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599464.487638:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787599464.487680:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577984768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.487687:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787599464.487894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577984768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599464.487902:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577985280:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.487928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.487947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577985792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.487967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.487985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577986304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.488009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.488044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787599464.488052:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577985152:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.488077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.488099:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577985664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.488125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599464.488136:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985280 00000100:00100000:3.0:1787599464.488141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985280 00000100:00100000:3.0:1787599464.488179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985664 00000100:00100000:3.0:1787599464.488183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985664 00000100:00100000:3.0:1787599464.488201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787599464.488208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.488239:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433577985280:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.488246:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787599464.488260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787599464.488267:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577985664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.488293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433577985664:12345-0@lo:400:kworker.0 Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.488298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000001:00080000:3.0:1787599464.488465:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787599464.488474:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:0.0:1787599464.489074:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577986176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.489118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.489181:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433577985280:0@lo:400:kworker.0 00010000:00080000:0.0:1787599464.489208:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa04a80 x1874433577985664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599464.489218:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433577985664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.489253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985792 00000100:00100000:3.0:1787599464.489254:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986304 00000100:00100000:0.0:1787599464.489259:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985792 00000100:00100000:3.0:1787599464.489261:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986304 00000100:00100000:0.0:1787599464.489300:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986176 00000100:00100000:0.0:1787599464.489304:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986176 00000100:00100000:3.0:1787599464.492640:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599464.492962:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.493091:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577985792:12345-0@lo:400:kworker.0 Request processed in 143us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.493099:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599464.493120:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599464.493127:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.493171:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577986304:12345-0@lo:400:kworker.0 Request processed in 46us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.493177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599464.493190:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787599464.493198:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577986176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599464.493241:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577986176:12345-0@lo:400:kworker.0 Request processed in 44us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599464.493247:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787599464.493844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577986176:0@lo:400:kworker.0 00000100:00100000:2.0:1787599464.493858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577985792:0@lo:400:kworker.0 00000100:00100000:2.0:1787599464.493869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577986304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.494649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577985152 00000100:00100000:0.0:1787599464.494667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577985152 00000100:00100000:0.0:1787599464.494719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787599464.494729:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577985152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.494837:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577985152:12345-0@lo:400:kworker.0 Request processed in 109us (6758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.494843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787599464.494931:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599464.494936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599464.494939:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599464.494942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599464.494981:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577985024:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.494997:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577985536:0@lo:400:kworker.0 00010000:00080000:0.0:1787599464.495015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f85bb80 x1874433577986048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599464.495025:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577985152:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.495029:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577986048:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.495048:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577984896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.495071:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577985408:0@lo:400:kworker.0 00000100:00100000:0.0:1787599464.495082:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577985920:0@lo:400:kworker.0 00010000:00010000:3.0:1787599464.676975:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599464.997106:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599464.997131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577986432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599464.997221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599464.997446:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986432 00000100:00100000:1.0:1787599464.997466:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986432 00000100:00100000:1.0:1787599464.997518:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599464.997528:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577986432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599464.997559:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599464.997619:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577986432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599464.997644:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787599464.997853:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577986432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599464.998001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577986560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599464.998030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599464.998110:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986560 00000100:00100000:0.0:1787599464.998115:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986560 00000100:00100000:0.0:1787599464.998158:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787599464.998167:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577986560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599464.998178:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599464.998223:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577986560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599464.998229:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787599464.998259:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577986560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599465.090641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599465.107849:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040640 00000100:00100000:0.0:1787599465.107873:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040640 00000100:00100000:2.0:1787599465.108083:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1787599465.108098:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11086:x1874433559040640:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787599465.108223:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11086:x1874433559040640:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 129us (17592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599465.108231:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00080000:0.0:1787599465.108438:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599465.122584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599465.122692:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559040768 00000100:00100000:3.0:1787599465.122704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559040768 00000100:00100000:3.0:1787599465.122786:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:3.0:1787599465.122832:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:11086:x1874433559040768:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787599465.122945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:11086:x1874433559040768:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599465.122953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00080000:0.0:1787599465.123015:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599465.124903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599465.125009:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041024 00000100:00100000:0.0:1787599465.125018:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041024 00000100:00100000:0.0:1787599465.125068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1787599465.125079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+13:11086:x1874433559041024:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599465.125335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+14:11086:x1874433559041024:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 256us (441us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787599465.125343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1787599465.486030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599465.486163:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041152 00000100:00100000:0.0:1787599465.486181:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041152 00000100:00100000:0.0:1787599465.486282:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:0.0:1787599465.486293:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:11885:x1874433559041152:12345-192.168.202.1@tcp:101:lsof.0 00000100:00080000:2.0:1787599465.486487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599465.486518:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599465.486542:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfcbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbccb expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486620:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486635:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486648:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599465.486697:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599465.486701:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599465.486738:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486762:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfcbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 7 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486780:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 6 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599465.486789:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:0.0:1787599465.486853:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599465.486857:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4600, rc 0) 00000100:00100000:0.0:1787599465.486910:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:11885:x1874433559041152:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 618us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599465.486924:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00010000:00010000:0.0:1787599465.701312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599466.023074:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599466.023100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577986688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599466.023218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599466.023509:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986688 00000100:00100000:2.0:1787599466.023518:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986688 00000100:00100000:2.0:1787599466.023570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787599466.023580:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577986688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599466.023614:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787599466.023673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577986688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599466.023680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787599466.024341:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577986688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599466.724969:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599467.467906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.467957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.467992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.468025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.468046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.468061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.468081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599467.468125:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041536 00000100:00100000:3.0:1787599467.468135:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041536 00000100:00100000:3.0:1787599467.468200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042048 00000100:00100000:3.0:1787599467.468203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042048 00000100:00100000:3.0:1787599467.468221:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:3.0:1787599467.468230:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559041536:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599467.468312:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559041536:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599467.468320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:2.0:1787599467.468547:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041792 00000100:00100000:2.0:1787599467.468553:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041792 00000100:00100000:2.0:1787599467.468589:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041664 00000100:00100000:2.0:1787599467.468592:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041664 00000100:00100000:1.0:1787599467.468612:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041408 00000100:00100000:1.0:1787599467.468618:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041408 00000100:00100000:1.0:1787599467.468651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041920 00000100:00100000:1.0:1787599467.468654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041920 00000100:00100000:1.0:1787599467.468670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:1.0:1787599467.468678:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559042048:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599467.468693:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1787599467.468711:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559042048:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599467.468718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:1.0:1787599467.468733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 310 00000100:00100000:1.0:1787599467.468740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+14:2406:x1874433559041408:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599467.468760:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559041792:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599467.468768:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+14:2406:x1874433559041408:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599467.468776:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 310 00000100:00100000:1.0:1787599467.468811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:1.0:1787599467.468818:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2406:x1874433559041920:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599467.468887:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559041792:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 184us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599467.468895:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1787599467.468946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559041280 00000100:00100000:0.0:1787599467.468950:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559041280 00000100:00100000:0.0:1787599467.468983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 385 00000100:00100000:0.0:1787599467.468989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559041280:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599467.469064:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433559041664:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599467.469972:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2406:x1874433559041920:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1150us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599467.469982:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00080000:1.0:1787599467.470063:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599467.470069:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599467.470085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599467.470087:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599467.470634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559041280:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1642us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599467.470643:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 385 00000100:00100000:3.0:1787599467.471003:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2437b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2406:x1874433559041664:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2098us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599467.472869:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1787599467.475919:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1787599467.557277:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577986816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599467.557357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599467.557577:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986816 00000100:00100000:0.0:1787599467.557586:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986816 00000100:00100000:0.0:1787599467.557644:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787599467.557655:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577986816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599467.557689:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599467.558324:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433577986816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 668us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599467.558333:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787599467.558403:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577986816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599467.749056:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599468.750217:0:14463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:24:27 (1787599467) 00010000:00010000:0.0:1787599468.773211:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787599469.096050:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787599469.096069:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787599469.096185:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787599469.096200:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787599469.605307:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577986944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599469.605381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599469.605464:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577987456:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599469.605521:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577987968:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599469.605561:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787599469.605567:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577987072:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599469.605610:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577987584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605644:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599469.605662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577987200:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605665:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577988096:0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.605698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599469.605718:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987456 00000100:00100000:3.0:1787599469.605732:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987456 00000100:00100000:0.0:1787599469.605737:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577986944 00000100:00100000:0.0:1787599469.605743:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577986944 00000100:00100000:0.0:1787599469.605783:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787599469.605788:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988096 00000100:00100000:3.0:1787599469.605811:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988096 00000100:00100000:0.0:1787599469.605815:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577986944:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599469.605838:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787599469.605846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577987456:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787599469.605859:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787599469.606203:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433577987456:12345-0@lo:400:kworker.0 Request processed in 357us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599469.606211:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787599469.606228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787599469.606235:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577988096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.606291:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577986944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 499us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599469.606299:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787599469.606321:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987072 00000100:00100000:0.0:1787599469.606324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987072 00000100:00100000:0.0:1787599469.606348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787599469.606354:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577987072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.606383:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433577987072:12345-0@lo:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599469.606388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787599469.606481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987584 00000100:00100000:0.0:1787599469.606485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987584 00000100:00100000:0.0:1787599469.606520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787599469.606526:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577987584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599469.606558:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577987584:12345-0@lo:400:kworker.0 Request processed in 32us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599469.606563:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787599469.607249:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987968 00000100:00100000:1.0:1787599469.607256:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987968 00000100:00100000:1.0:1787599469.607292:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599469.607298:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577987968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607337:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577987968:12345-0@lo:400:kworker.0 Request processed in 39us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.607343:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787599469.607409:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599469.607415:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599469.607443:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577988608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599469.607473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607500:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599469.607506:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577988480:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607583:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988608 00000100:00100000:1.0:1787599469.607588:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988608 00000100:00100000:1.0:1787599469.607624:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599469.607630:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577988608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599469.607644:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787599469.607677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243677b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577988608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.607683:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599469.607719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577987712:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607786:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577988224:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607847:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599469.607854:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577987328:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607904:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577987840:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.607970:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577988352:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.607993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599469.608018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987200 00000100:00100000:1.0:1787599469.608033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987200 00000100:00100000:1.0:1787599469.608053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987712 00000100:00100000:1.0:1787599469.608056:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987712 00000100:00100000:1.0:1787599469.608075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988224 00000100:00100000:1.0:1787599469.608078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988224 00000100:00100000:1.0:1787599469.608089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987840 00000100:00100000:1.0:1787599469.608092:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987840 00000100:00100000:1.0:1787599469.608116:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787599469.608123:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577987200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608159:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577987200:12345-0@lo:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.608165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787599469.608178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787599469.608184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577987712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577987712:12345-0@lo:400:kworker.0 Request processed in 38us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.608228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787599469.608240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787599469.608246:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577988224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577988224:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.608276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787599469.608285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787599469.608291:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577987840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577987840:12345-0@lo:400:kworker.0 Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599469.608319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:1.0:1787599469.608332:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599469.608335:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599469.608365:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787599469.608370:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787599469.608400:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577988608:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787599469.608425:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f85bb80 x1874433577987840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599469.608436:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577987840:0@lo:400:kworker.0 00010000:00080000:1.0:1787599469.608445:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b351f5aa00 x1874433577988224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599469.608453:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577988224:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608473:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577987200:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608482:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577987712:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608516:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433577987072:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.608528:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577987584:0@lo:400:kworker.0 00000100:00100000:2.0:1787599469.608607:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577987328 00000100:00100000:2.0:1787599469.608612:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577987328 00000100:00100000:2.0:1787599469.608636:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787599469.608642:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577987328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599469.608683:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577987328:12345-0@lo:400:kworker.0 Request processed in 41us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599469.608689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787599469.608704:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988480 00000100:00100000:2.0:1787599469.608707:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988480 00000100:00100000:2.0:1787599469.608728:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988352 00000100:00100000:2.0:1787599469.608731:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988352 00000100:00100000:2.0:1787599469.608746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787599469.608751:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577988480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599469.609056:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433577988096:12345-0@lo:400:kworker.0 Request processed in 2820us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599469.609065:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787599469.609086:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787599469.609115:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577988352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599469.609145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577988352:12345-0@lo:400:kworker.0 Request processed in 32us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599469.609152:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787599469.609160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433577988096:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.609176:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433577987456:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.609187:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577987968:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.609203:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577986944:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787599469.609272:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599469.609301:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577987328:0@lo:400:kworker.0 00000100:00100000:1.0:1787599469.609312:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577988352:0@lo:400:kworker.0 00000100:00100000:2.0:1787599469.609332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577988480:12345-0@lo:400:kworker.0 Request processed in 579us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599469.609340:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787599469.609397:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577988480:0@lo:400:kworker.0 00010000:00010000:0.0:1787599469.801768:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599470.117081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577988736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599470.117165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599470.117282:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988736 00000100:00100000:2.0:1787599470.117290:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988736 00000100:00100000:2.0:1787599470.117343:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787599470.117353:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577988736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599470.117384:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599470.117448:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577988736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599470.117455:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787599470.117501:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577988736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599470.117908:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599470.117918:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577988864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599470.117949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599470.122939:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988864 00000100:00100000:1.0:1787599470.122962:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988864 00000100:00100000:1.0:1787599470.123050:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787599470.123063:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577988864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599470.123106:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599470.123212:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577988864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599470.123220:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787599470.123425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2434e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577988864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599470.166477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599470.166690:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042304 00000100:00100000:1.0:1787599470.166701:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042304 00000100:00100000:1.0:1787599470.166835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:1.0:1787599470.166849:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:12152:x1874433559042304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599470.166871:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599470.166893:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfcca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcd2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.166964:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.166977:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.166987:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167007:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167013:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167126:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfcdf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167135:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfcdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167160:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfcdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599470.167171:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787599470.167275:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167283:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167289:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167295:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599470.167299:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167306:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167317:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:1.0:1787599470.167319:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599470.167323:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167328:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfcd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167342:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167348:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167359:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167364:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599470.167367:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167374:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167382:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96b370675d00) 00010000:00010000:1.0:1787599470.167385:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:2.0:1787599470.167387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787599470.167388:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfcd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167676:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfcca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcd2 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167690:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfcdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcd2 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599470.167698:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:1.0:1787599470.167701:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599470.167703:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a200, rc 0) 00000100:00100000:1.0:1787599470.167767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+15:12152:x1874433559042304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 922us (1300us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787599470.167783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:1.0:1787599470.179119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599470.180542:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042432 00000100:00100000:2.0:1787599470.180556:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042432 00000100:00100000:2.0:1787599470.180629:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:2.0:1787599470.180640:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+15:12152:x1874433559042432:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787599470.180751:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+15:12152:x1874433559042432:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 114us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599470.180759:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:2.0:1787599470.186255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599470.186364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042560 00000100:00100000:3.0:1787599470.186373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042560 00000100:00100000:3.0:1787599470.186429:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599470.186436:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+15:2404:x1874433559042560:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599470.186451:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599470.186487:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfcdf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcd2 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599470.186517:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:3.0:1787599470.186522:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599470.186582:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+14:2404:x1874433559042560:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 145us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599470.186591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1787599470.190093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599470.190207:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042688 00000100:00100000:1.0:1787599470.190216:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042688 00000100:00100000:1.0:1787599470.190280:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:1.0:1787599470.190288:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:12152:x1874433559042688:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787599470.190373:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:12152:x1874433559042688:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599470.190378:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00080000:2.0:1787599470.190735:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787599470.568677:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599470.568688:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599470.569439:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787599470.569607:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787599470.693968:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599470.820901:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599471.140935:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577988992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599471.141015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599471.141327:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577988992 00000100:00100000:2.0:1787599471.141336:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577988992 00000100:00100000:2.0:1787599471.141385:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787599471.141394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577988992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599471.141429:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787599471.141496:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577988992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599471.141503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787599471.141513:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577988992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599471.845732:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599472.241374:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.241512:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559042816 00000100:00100000:3.0:1787599472.241522:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559042816 00000100:00100000:3.0:1787599472.241597:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:3.0:1787599472.241609:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+14:12194:x1874433559042816:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599472.241631:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599472.241651:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241712:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241725:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241735:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241749:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241756:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241776:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241835:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241842:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241848:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241854:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599472.241858:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241864:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241875:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:3.0:1787599472.241878:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599472.241882:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241889:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfcf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241899:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241905:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241916:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241921:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599472.241924:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241930:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241936:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96b242e62100) 00010000:00010000:3.0:1787599472.241938:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599472.241941:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241946:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfcfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241973:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfced lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcd9 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241981:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:3.0:1787599472.241983:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599472.241987:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcd9 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.241995:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d800, rc 0) 00000100:00100000:3.0:1787599472.242045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+14:12194:x1874433559042816:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 439us (686us total) trans 0 rc 301/301 00000100:00100000:3.0:1787599472.242060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00080000:2.0:1787599472.242413:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599472.250866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.250936:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043072 00000100:00100000:2.0:1787599472.250946:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043072 00000100:00100000:2.0:1787599472.251010:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1787599472.251020:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+14:12194:x1874433559043072:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1787599472.251072:0:13004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599472.251118:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cf641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbafd expref: 14 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.251136:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:2.0:1787599472.251141:0:13004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599472.251199:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.251214:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 5 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.251224:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.251270:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 5 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.251285:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 5 pid: 13004 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.251319:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577989120:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599472.251411:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599472.262537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599472.262570:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043200 00000100:00100000:1.0:1787599472.262577:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043200 00010000:00010000:1.0:1787599472.262635:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 6 pid: 13004 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599472.262666:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1787599472.262676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2404:x1874433559043200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599472.262691:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599472.262698:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 6 pid: 13004 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.262722:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 6 pid: 13004 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.262743:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:1.0:1787599472.262749:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.262757:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.262764:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.262782:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599472.262864:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2404:x1874433559043200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599472.262872:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00080000:1.0:1787599472.262984:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599472.263367:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4600/0x5d2988b0929cfcc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbccb expref: 5 pid: 13004 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.263383:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577989120:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599472.263405:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.263415:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.263421:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.263443:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.263452:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.263461:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264683:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264698:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264715:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599472.264732:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccc7b5c7 reply state 00000000b0ba2b29 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264744:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264751:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599472.264754:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599472.264758:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787599472.264763:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787599472.264771:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264777:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264785:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264980:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599472.264985:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.264994:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.265004:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242d00000) 00010000:00010000:2.0:1787599472.265007:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599472.265017:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.265024:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599472.265042:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccc7b5c7 reply state 00000000b0ba2b29 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.265051:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.265058:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96b342bf1800) 00010000:00010000:2.0:1787599472.265060:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599472.265062:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787599472.265149:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+15:12194:x1874433559043072:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 14127us (14289us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787599472.265157:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:1.0:1787599472.525046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.525187:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043328 00000100:00100000:3.0:1787599472.525198:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043328 00000100:00100000:3.0:1787599472.525265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:3.0:1787599472.525275:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+15:12202:x1874433559043328:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:3.0:1787599472.525302:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599472.525328:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbce0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525393:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525407:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525420:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599472.525465:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787599472.525468:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599472.525486:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525509:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525530:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce0 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.525560:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:3.0:1787599472.525563:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599472.525566:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d800, rc 0) 00000100:00100000:3.0:1787599472.525629:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+16:12202:x1874433559043328:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 355us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599472.525636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:3.0:1787599472.606911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.606944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.606986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.607019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.607069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.607115:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043968 00000100:00100000:3.0:1787599472.607127:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043968 00000100:00100000:2.0:1787599472.607128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043584 00000100:00100000:2.0:1787599472.607135:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043584 00000100:00100000:1.0:1787599472.607196:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043712 00000100:00100000:1.0:1787599472.607201:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043712 00000100:00100000:3.0:1787599472.607279:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 318 00000100:00100000:3.0:1787599472.607289:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559043968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599472.607361:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2404:x1874433559043968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599472.607370:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 318 00000100:00100000:3.0:1787599472.607393:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043840 00000100:00100000:3.0:1787599472.607396:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043840 00000100:00100000:0.0:1787599472.608200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559043456 00000100:00100000:0.0:1787599472.608208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559043456 00000100:00100000:0.0:1787599472.608259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 387 00000100:00100000:0.0:1787599472.608268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433559043456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599472.608306:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2404:x1874433559043456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599472.608313:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 387 00000100:00100000:2.0:1787599472.614275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 319 00000100:00100000:2.0:1787599472.614294:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559043584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599472.614304:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1787599472.614316:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559043712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599472.614415:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1787599472.614424:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559043840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599472.614425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559043584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (7353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.614440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 319 00000100:00100000:1.0:1787599472.614480:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2434e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559043712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 166us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599472.614488:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:3.0:1787599472.614649:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2404:x1874433559043840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 226us (7579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599472.614656:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000040:00080000:2.0:1787599472.614907:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599472.614912:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599472.615030:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787599472.615036:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599472.616929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599472.617070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044096 00000100:00100000:1.0:1787599472.617193:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044096 00000100:00100000:1.0:1787599472.617306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:1.0:1787599472.617317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+16:12208:x1874433559044096:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599472.617337:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599472.617360:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfd25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbce7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617426:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617442:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617455:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617467:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617475:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617482:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617555:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599472.617681:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787599472.617685:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599472.617705:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617718:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617724:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617731:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617737:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599472.617741:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617748:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617761:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:1.0:1787599472.617765:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599472.617770:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.617777:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfd2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618346:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618367:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618373:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618378:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599472.618381:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618387:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618397:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96b342bf1800) 00010000:00010000:1.0:1787599472.618400:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599472.618403:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618408:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfd33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618438:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfd25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce7 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618452:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce7 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.618459:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599472.618462:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599472.618471:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a000, rc 0) 00000100:00100000:1.0:1787599472.618528:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+17:12208:x1874433559044096:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1212us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599472.618535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00080000:0.0:1787599472.619524:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599472.619532:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599472.619536:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599472.623047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.623158:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044352 00000100:00100000:2.0:1787599472.623182:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044352 00000100:00100000:3.0:1787599472.623324:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:3.0:1787599472.623338:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+17:12208:x1874433559044352:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599472.623359:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599472.623380:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcee expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623485:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623500:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623511:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623546:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623554:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.623561:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599472.623911:0:13004:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787599472.624035:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624044:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624065:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624110:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624118:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624124:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624131:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599472.624135:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624143:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624156:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599472.624159:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599472.624164:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624171:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfd48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599472.624183:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006adfe79f reply state 0000000019318872 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624193:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624205:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:3.0:1787599472.624208:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599472.624210:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787599472.624491:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 20 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624509:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 19 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.624518:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:3.0:1787599472.624520:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599472.624523:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599472.624647:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+20:12208:x1874433559044352:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1311us (1608us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787599472.624655:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:3.0:1787599472.628386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.628531:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044480 00000100:00100000:2.0:1787599472.628542:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044480 00000100:00100000:2.0:1787599472.628611:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1787599472.628624:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559044480:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599472.628643:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.628666:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcf5 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599472.628695:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599472.628718:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1787599472.628723:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.628733:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.628754:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.628769:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599472.628871:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2405:x1874433559044480:12345-192.168.202.1@tcp:101:bash.0 Request processed in 249us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.628878:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1787599472.630876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.630988:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044608 00000100:00100000:2.0:1787599472.630997:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044608 00000100:00100000:2.0:1787599472.631048:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599472.631058:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+6:12208:x1874433559044608:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599472.631084:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.631114:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbcfc expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.631144:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.631155:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.631159:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.631165:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.631204:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.631219:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.631233:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577989248:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599472.631410:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ecd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599472.634660:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577989248:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599472.634700:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.634720:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599472.634868:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:12208:x1874433559044608:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3809us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.634891:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1787599472.636222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.637259:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044736 00000100:00100000:2.0:1787599472.637271:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044736 00010000:00010000:2.0:1787599472.637311:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.637352:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1787599472.637362:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559044736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599472.637375:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599472.637396:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.637411:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.637433:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfd64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcf5 expref: 7 pid: 8435 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.637449:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.637454:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.637462:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.637473:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.637530:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.637546:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874433577989376:192.168.202.1@tcp:105: 00000100:00100000:2.0:1787599472.637734:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599472.640277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.640383:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1874433577989376:192.168.202.1@tcp:105: 00010000:00010000:2.0:1787599472.640405:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599472.640454:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559044736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3093us (4236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.640465:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1787599472.641479:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559044992 00000100:00100000:1.0:1787599472.641489:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559044992 00000100:00100000:1.0:1787599472.641576:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1787599472.641586:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:12208:x1874433559044992:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1787599472.641894:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12208:x1874433559044992:12345-192.168.202.1@tcp:35:bash.0 Request processed in 308us (1624us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787599472.641901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1787599472.677386:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b242ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577989504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599472.677473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599472.677600:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577989504 00000100:00100000:0.0:1787599472.677608:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577989504 00000100:00100000:0.0:1787599472.677654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787599472.677664:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577989504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599472.677713:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599472.677764:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577989504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599472.677772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787599472.681441:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b242ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577989504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599472.711675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.711896:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559045248 00000100:00100000:2.0:1787599472.711909:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559045248 00000100:00100000:2.0:1787599472.711974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:2.0:1787599472.711985:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12218:x1874433559045248:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599472.712013:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.712034:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599472.712145:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787599472.712257:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd03 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.712271:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:2.0:1787599472.712275:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599472.712295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd03 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.712310:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599472.712374:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:12218:x1874433559045248:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 391us (708us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787599472.712382:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1787599472.715070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599472.715181:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559045504 00000100:00100000:0.0:1787599472.715190:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559045504 00000100:00100000:0.0:1787599472.715255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1787599472.715265:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:12218:x1874433559045504:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599472.715480:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:12218:x1874433559045504:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 215us (419us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787599472.715489:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000040:00080000:1.0:1787599472.741277:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787599472.752409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.752466:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559045632 00000100:00100000:3.0:1787599472.752475:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559045632 00000100:00100000:3.0:1787599472.752529:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:3.0:1787599472.752536:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+23:12224:x1874433559045632:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599472.752570:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599472.752587:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd0a expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752651:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752661:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752669:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599472.752701:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787599472.752704:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599472.752718:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752736:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfd80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd0a expref: 25 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752749:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd0a expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.752755:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599472.752757:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599472.752759:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d400, rc 0) 00000100:00100000:3.0:1787599472.752902:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b242ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12224:x1874433559045632:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 365us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599472.752906:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:3.0:1787599472.755529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.755585:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559045888 00000100:00100000:2.0:1787599472.755604:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559045888 00000100:00100000:2.0:1787599472.755665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1787599472.755676:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12224:x1874433559045888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599472.755695:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.755715:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd11 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.755854:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfd95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.755869:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.755880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599472.755892:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787599472.756000:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cfd8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd11 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.756019:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfd95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd11 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.756041:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:2.0:1787599472.756044:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599472.756048:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:2.0:1787599472.756113:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+26:12224:x1874433559045888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 438us (590us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787599472.756122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:1.0:1787599472.757957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.758333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046144 00000100:00100000:3.0:1787599472.758342:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046144 00000100:00100000:0.0:1787599472.758402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599472.758451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1787599472.758462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+26:12224:x1874433559046144:12345-192.168.202.1@tcp:101:lfs.0 00000100:00100000:2.0:1787599472.758478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046272 00010000:00010000:3.0:1787599472.758482:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787599472.758483:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046272 00010000:00010000:3.0:1787599472.758503:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfda3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.758657:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1787599472.758667:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+28:2406:x1874433559046272:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599472.758677:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599472.758695:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929cfd95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd11 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.758711:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:2.0:1787599472.758715:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599472.758761:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+27:2406:x1874433559046272:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.758768:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:3.0:1787599472.759213:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.759228:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.759245:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599472.759256:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787599472.759348:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfda3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd18 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.759364:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd18 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599472.759372:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:3.0:1787599472.759375:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599472.759377:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d200, rc 0) 00000100:00100000:3.0:1787599472.759418:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12224:x1874433559046144:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 958us (1468us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1787599472.759438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:0.0:1787599472.763018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.763070:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046400 00000100:00100000:2.0:1787599472.763090:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046400 00000100:00100000:2.0:1787599472.763175:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1787599472.763186:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559046400:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1787599472.763226:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.763271:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.763280:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599472.763284:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599472.763288:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.763324:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.763337:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 6 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.763352:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874433577989632:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599472.763450:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599472.764560:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874433577989632:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599472.764579:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599472.765342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599472.766001:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046528 00000100:00100000:1.0:1787599472.766010:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046528 00002000:00100000:1.0:1787599472.766052:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff96b24405ea00 x1874433559046528/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:328/0 lens 504/0 e 0 to 0 dl 1787599483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599472.766064:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b24405ea00 with x1874433559046528 ext(0->12) 00010000:00010000:1.0:1787599472.766082:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 7 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.766098:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 7 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599472.766125:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b24405ea00 00000100:00100000:1.0:1787599472.766158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1787599472.766167:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559046528:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1787599472.775850:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559046528:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 9671us (10498us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787599472.775865:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:1.0:1787599472.775880:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff96b24405ea00 x1874433559046528/t4294967306(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:328/0 lens 504/448 e 0 to 0 dl 1787599483 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599472.775891:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b24405ea00 with x1874433559046528 ext(0->12) 00010000:00010000:1.0:1787599472.775902:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.775921:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599472.775931:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b24405ea00 00000100:00100000:1.0:1787599472.783002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.783059:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046656 00000100:00100000:2.0:1787599472.783078:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046656 00010000:00010000:2.0:1787599472.783123:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.783325:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1787599472.783405:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559046656:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599472.783417:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787599472.783431:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787599472.783435:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787599472 00002000:00010000:2.0:1787599472.783437:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787599472 00002000:00010000:2.0:1787599472.783439:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787599472 00002000:00010000:2.0:1787599472.783441:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787599472.783448:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.783462:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.783486:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929cfd6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcfc expref: 9 pid: 8433 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.783499:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599472.783501:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599472.783506:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.783513:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.783549:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599472.783578:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783591:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.783596:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559046656:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.783611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:0.0:1787599472.783623:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783634:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783654:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783661:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599472.783665:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783674:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783686:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.783694:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929cfdb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599472.783742:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559046400:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 20558us (20731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599472.783751:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1787599472.792201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599472.792314:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559046912 00000100:00100000:0.0:1787599472.792326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559046912 00000100:00100000:0.0:1787599472.792388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1787599472.792399:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12224:x1874433559046912:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:0.0:1787599472.792461:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd18 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599472.792690:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787599472.792723:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787599472.793049:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787599472.793098:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.793112:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 31 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.793122:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.793166:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 31 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.793181:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 31 pid: 13004 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599472.793197:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874433577989760:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599472.794486:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787599472.797973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599472.798386:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874433577989760:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599472.798413:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.801144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559047040 00000100:00100000:2.0:1787599472.801158:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559047040 00010000:00010000:2.0:1787599472.801209:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 32 pid: 13004 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599472.801257:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1787599472.801268:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:2404:x1874433559047040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599472.801281:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599472.801289:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 32 pid: 13004 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801302:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 32 pid: 13004 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801323:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cfd56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcee expref: 32 pid: 13004 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801350:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:2.0:1787599472.801355:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801379:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801385:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.801416:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599472.801478:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+31:2404:x1874433559047040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 212us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.801485:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00010000:00010000:1.0:1787599472.802862:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.802875:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599472.802985:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787599472.803117:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787599472.803228:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577989888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787599472.803300:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599472.803338:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599472.808595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577989888 00000100:00100000:2.0:1787599472.808609:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577989888 00000100:00100000:2.0:1787599472.808691:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787599472.808702:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577989888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787599472.808873:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577989888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 172us (5572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.808881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1787599472.809042:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599472.809090:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577989888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787599472.809232:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1787599472.809298:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577990016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787599472.809344:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599472.809370:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599472.811385:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577990016 00000100:00100000:2.0:1787599472.811398:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577990016 00000100:00100000:2.0:1787599472.811446:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787599472.811456:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577990016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787599472.811636:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874433577990016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (2303us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787599472.811644:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787599472.811848:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577990016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787599472.811909:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787599472.811948:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.811958:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.811966:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.811972:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599472.811977:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.811985:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.812000:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:1.0:1787599472.812003:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787599472.812022:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599472.812029:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cfdbf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599472.812153:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787599472.812215:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787599472.812226:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419431432899ns, next at 420431430330ns, rc = 0 00000001:00080000:1.0:1787599472.812232:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787599472.812265:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62e00) 00010000:00010000:1.0:1787599472.812268:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787599472.812274:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfdaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd18 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599472.812381:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+34:12224:x1874433559046912:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 19983us (20190us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787599472.812389:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000020:00080000:1.0:1787599472.812393:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787599472.815106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.815251:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559047168 00000100:00100000:2.0:1787599472.815261:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559047168 00000100:00100000:2.0:1787599472.815312:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:2.0:1787599472.815335:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+34:12224:x1874433559047168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599472.815359:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.815382:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfdc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd1f expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.815433:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfdc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd1f expref: 35 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.815448:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfdc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd1f expref: 35 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.815467:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599472.815470:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599472.815474:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599472.815532:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+35:12224:x1874433559047168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 199us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599472.815540:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:3.0:1787599472.828892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599472.828997:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559047424 00000100:00100000:1.0:1787599472.829008:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559047424 00000100:00100000:1.0:1787599472.829087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1787599472.829099:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+35:12224:x1874433559047424:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599472.829342:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+36:12224:x1874433559047424:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 236us (454us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787599472.829350:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:0.0:1787599472.869014:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599472.879808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.883731:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559047680 00000100:00100000:2.0:1787599472.883749:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559047680 00000100:00100000:2.0:1787599472.883882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:2.0:1787599472.883893:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+36:12235:x1874433559047680:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599472.883918:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599472.883938:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfdcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599472.884030:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787599472.884133:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfdcd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd26 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.884163:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:2.0:1787599472.884166:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599472.884172:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfdcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd26 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599472.884187:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758a00, rc 0) 00000100:00100000:2.0:1787599472.884261:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12235:x1874433559047680:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 370us (4478us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787599472.884268:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1787599472.887497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599472.887608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559047808 00000100:00100000:0.0:1787599472.887618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559047808 00000100:00100000:0.0:1787599472.887691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1787599472.887701:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12235:x1874433559047808:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1787599472.887778:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887842:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887855:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887863:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887869:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887950:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887959:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.887965:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599472.888030:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888043:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888055:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888061:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888067:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.888081:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888090:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888101:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599472.888104:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599472.888109:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfddb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888128:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888134:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888140:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888145:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.888154:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888161:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888169:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:0.0:1787599472.888171:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599472.888175:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888181:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfde2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888189:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888195:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888200:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888205:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.888207:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888213:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888219:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599472.888221:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599472.888230:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.888236:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfde9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599472.888302:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12235:x1874433559047808:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 602us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599472.888309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1787599472.890253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599472.890366:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559048064 00000100:00100000:1.0:1787599472.890376:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559048064 00000100:00100000:1.0:1787599472.890480:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1787599472.890491:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12235:x1874433559048064:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599472.890673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:12235:x1874433559048064:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 184us (429us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787599472.890681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1787599472.941275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.943761:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559048320 00000100:00100000:2.0:1787599472.943776:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559048320 00000100:00100000:0.0:1787599472.943997:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:0.0:1787599472.944009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:12238:x1874433559048320:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599472.944035:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599472.944057:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfdf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd2d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944141:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944155:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944165:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944175:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944182:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944189:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944384:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944394:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944400:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599472.944410:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787599472.944488:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944495:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944500:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944505:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.944509:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944516:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944527:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599472.944530:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599472.944534:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944550:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfdf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944563:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944569:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944574:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944579:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.944582:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944657:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944668:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:0.0:1787599472.944671:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599472.944674:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfdfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944715:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfdf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944729:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.944743:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599472.944746:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599472.944749:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5000, rc 0) 00000100:00100000:0.0:1787599472.944926:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12238:x1874433559048320:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 918us (3667us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787599472.944933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1787599472.947271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599472.947342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559048448 00000100:00100000:0.0:1787599472.947351:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559048448 00000100:00100000:0.0:1787599472.947446:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:0.0:1787599472.947456:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12238:x1874433559048448:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1787599472.947515:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947530:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947539:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947569:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947576:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947582:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947588:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599472.947606:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947612:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947623:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599472.947626:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599472.947629:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599472.947635:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599472.947704:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12238:x1874433559048448:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 249us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599472.947711:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1787599472.949529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599472.949627:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559048704 00000100:00100000:2.0:1787599472.949637:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559048704 00000100:00100000:2.0:1787599472.949692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1787599472.949702:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12238:x1874433559048704:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1787599472.949958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+41:12238:x1874433559048704:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 255us (436us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787599472.949966:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1787599473.147838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599473.147900:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559048960 00000100:00100000:1.0:1787599473.147910:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559048960 00000100:00100000:1.0:1787599473.148007:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:1.0:1787599473.148019:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+41:12269:x1874433559048960:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1787599473.148045:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599473.148080:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd34 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.148183:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.148198:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.148206:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599473.148217:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787599473.148303:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd34 expref: 44 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.148321:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd34 expref: 43 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.148345:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599473.148347:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599473.148350:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599473.148413:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12269:x1874433559048960:12345-192.168.202.1@tcp:101:cat.0 Request processed in 397us (623us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787599473.148422:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1787599473.152214:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.154551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599473.154878:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559049344 00000100:00100000:2.0:1787599473.154887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559049216 00000100:00100000:1.0:1787599473.154889:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559049344 00000100:00100000:2.0:1787599473.154908:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559049216 00000100:00100000:1.0:1787599473.154951:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1787599473.154962:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+44:2405:x1874433559049344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599473.154977:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599473.155001:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd34 expref: 44 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599473.155019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00010000:00010000:1.0:1787599473.155022:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599473.155027:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599473.155047:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12269:x1874433559049216:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1787599473.155098:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+43:2405:x1874433559049344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 136us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599473.155106:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1787599473.155388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12269:x1874433559049216:12345-192.168.202.1@tcp:35:cat.0 Request processed in 345us (3183us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787599473.155395:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1787599473.188966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.189465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559049600 00000100:00100000:3.0:1787599473.189475:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559049600 00000100:00100000:3.0:1787599473.189534:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:3.0:1787599473.189554:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12275:x1874433559049600:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1787599473.189579:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599473.189583:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787599473.189611:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfd87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd0a expref: 43 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189632:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599473.189637:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599473.189651:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfe2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd3b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189782:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189829:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189870:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.189884:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 43 pid: 6521 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599473.189899:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244201180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577990144:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599473.190000:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599473.192061:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244201180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577990144:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599473.192103:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.192505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599473.192572:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559049728 00000100:00100000:1.0:1787599473.192580:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559049728 00010000:00010000:1.0:1787599473.192618:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 44 pid: 6521 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599473.192664:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1787599473.192675:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+44:2404:x1874433559049728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599473.192708:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599473.192717:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 44 pid: 6521 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192732:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 44 pid: 6521 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192753:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfe05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd2d expref: 44 pid: 6521 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192768:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599473.192773:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192782:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192789:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.192834:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599473.192869:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.192879:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599473.192887:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+43:2404:x1874433559049728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 212us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599473.192896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000004:00200000:0.0:1787599473.192899:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787599473.193132:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cfe2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.193159:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.193167:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.193171:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787599473.193174:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:0.0:1787599473.193216:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12275:x1874433559049600:12345-192.168.202.1@tcp:101:dd.0 Request processed in 3673us (4258us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787599473.193224:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:0.0:1787599473.203034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.203159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559049856 00000100:00100000:3.0:1787599473.203170:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559049856 00000100:00100000:3.0:1787599473.203301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:3.0:1787599473.203313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12275:x1874433559049856:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1787599473.203342:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599473.203366:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfe44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd42 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203408:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203426:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203454:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203567:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfe44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203587:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.203596:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599473.203599:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599473.203603:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599473.203690:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+44:12275:x1874433559049856:12345-192.168.202.1@tcp:101:dd.0 Request processed in 375us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599473.203698:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:0.0:1787599473.219924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.220114:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559050112 00000100:00100000:3.0:1787599473.220125:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559050112 00000100:00100000:3.0:1787599473.220193:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1787599473.220204:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+44:12275:x1874433559050112:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:1.0:1787599473.221034:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.221054:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.221093:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599473.221137:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787599473.221161:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005124de93 reply state 0000000002cee85a transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.221173:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.221181:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599473.221184:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599473.221188:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599473.221300:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+47:12275:x1874433559050112:12345-192.168.202.1@tcp:36:dd.0 Request processed in 1095us (1722us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787599473.221308:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000020:00080000:1.0:1787599473.221313:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787599473.392570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.392744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559050240 00000100:00100000:0.0:1787599473.392752:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559050240 00000100:00100000:0.0:1787599473.392838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:0.0:1787599473.392849:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+47:12289:x1874433559050240:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1787599473.392872:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599473.392893:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd49 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.392954:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.392968:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.392979:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393006:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393013:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393019:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393116:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393127:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393326:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393362:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.393374:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 48 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.393387:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577990272:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599473.393504:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599473.394911:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577990272:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599473.394935:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599473.395923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.396019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559050496 00000100:00100000:2.0:1787599473.396027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559050496 00000100:00100000:2.0:1787599473.396112:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1787599473.396122:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+49:6645:x1874433559050496:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787599473.396452:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+50:6645:x1874433559050496:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 332us (533us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787599473.396457:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1787599473.397866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.398264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559050624 00000100:00100000:0.0:1787599473.398272:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559050624 00010000:00010000:0.0:1787599473.398304:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 50 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.398333:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1787599473.398339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+50:2404:x1874433559050624:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599473.398349:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599473.398353:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 50 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398362:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 50 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398379:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cfe36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd3b expref: 50 pid: 6521 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398391:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.398395:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398402:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398407:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.398490:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599473.398543:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244203480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+49:2404:x1874433559050624:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 203us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599473.398547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00010000:00010000:3.0:1787599473.399248:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399260:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599473.399309:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787599473.399320:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599473.399339:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399351:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399360:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399367:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399373:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399380:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599473.399384:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399391:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399402:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599473.399404:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599473.399407:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfe60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399424:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399438:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399444:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399449:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599473.399452:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399458:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399465:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:3.0:1787599473.399467:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599473.399469:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399475:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929cfe67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399502:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cfe59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd49 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399514:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd49 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.399521:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599473.399524:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599473.399531:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5400, rc 0) 00000100:00100000:3.0:1787599473.399604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+48:12289:x1874433559050240:12345-192.168.202.1@tcp:101:stat.0 Request processed in 6756us (7041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599473.399611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:3.0:1787599473.483598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.483710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559050880 00000100:00100000:0.0:1787599473.483720:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559050880 00000100:00100000:0.0:1787599473.483789:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:0.0:1787599473.483841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+48:12295:x1874433559050880:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:0.0:1787599473.483911:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599473.483941:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929cfe6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd49 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.483960:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.483966:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599473.484143:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.484156:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.484166:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599473.484205:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787599473.484226:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dafa5666 reply state 000000004f409da2 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.484251:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.484259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.484276:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599473.484280:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599473.484376:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+50:12295:x1874433559050880:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 538us (789us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787599473.484384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000020:00080000:0.0:1787599473.484388:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787599473.604350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599473.605164:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559051008 00000100:00100000:1.0:1787599473.605176:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559051008 00000100:00100000:1.0:1787599473.605295:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:1.0:1787599473.605306:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+50:12309:x1874433559051008:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:1.0:1787599473.605333:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599473.605354:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfe7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd50 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605423:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605452:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605464:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605477:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605484:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605490:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605575:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605596:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605604:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599473.605648:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787599473.605751:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599473.605779:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605830:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605848:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605854:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605860:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605866:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599473.605870:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605877:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605888:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599473.605891:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599473.605896:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605902:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cfe83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605916:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605922:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605927:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605938:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599473.605942:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605948:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605957:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:1.0:1787599473.605959:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599473.605962:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605968:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929cfe8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.605995:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929cfe7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 52 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.606009:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 51 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599473.606016:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599473.606019:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599473.606021:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ac00, rc 0) 00000100:00100000:1.0:1787599473.606096:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+51:12309:x1874433559051008:12345-192.168.202.1@tcp:101:stat.0 Request processed in 791us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599473.606104:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:1.0:1787599473.685191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.685353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559051264 00000100:00100000:3.0:1787599473.685364:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559051264 00000100:00100000:3.0:1787599473.685422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1787599473.685434:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+51:12319:x1874433559051264:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599473.685454:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599473.685474:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfe98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd57 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599473.685569:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787599473.685680:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfe98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd57 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.685696:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:3.0:1787599473.685699:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599473.685703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfe98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd57 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.685718:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d400, rc 0) 00000100:00100000:3.0:1787599473.685785:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+52:12319:x1874433559051264:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 353us (602us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787599473.685843:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1787599473.690605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599473.691430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559051520 00000100:00100000:1.0:1787599473.691441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559051520 00000100:00100000:0.0:1787599473.691585:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1787599473.691597:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+52:12319:x1874433559051520:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599473.692094:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+53:12319:x1874433559051520:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 498us (1498us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787599473.692103:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1787599473.758125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.758227:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559051776 00000100:00100000:2.0:1787599473.758249:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559051776 00000100:00100000:2.0:1787599473.758338:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:2.0:1787599473.758352:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+53:12325:x1874433559051776:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599473.758380:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599473.758405:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfea6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd5e expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.758519:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.758533:0:13004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 54 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.758542:0:13004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.758575:0:13004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 54 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.758588:0:13004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 54 pid: 10099 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599473.758619:0:13004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577990400:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599473.758936:0:13004:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ecd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599473.763566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.763681:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559051904 00000100:00100000:0.0:1787599473.763691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559051904 00010000:00010000:0.0:1787599473.763730:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 55 pid: 10099 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.763772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1787599473.763781:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+55:2403:x1874433559051904:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599473.763992:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599473.764001:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 55 pid: 10099 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.764014:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 55 pid: 10099 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.764037:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.764057:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.764079:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.764090:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.764108:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599473.764164:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+55:2403:x1874433559051904:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 383us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599473.764171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00010000:00010000:2.0:1787599473.764849:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cfe91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd50 expref: 54 pid: 10099 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599473.764870:0:13004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13004:1874433577990400:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599473.764894:0:13004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.764904:0:13004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.764910:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599473.764930:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787599473.765060:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfea6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 55 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.765088:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 54 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.765097:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599473.765100:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599473.765103:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759e00, rc 0) 00000100:00100000:2.0:1787599473.765149:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+54:12325:x1874433559051776:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6801us (7035us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787599473.765165:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:1.0:1787599473.769628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.769788:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559052160 00000100:00100000:2.0:1787599473.769853:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559052160 00000100:00100000:2.0:1787599473.769932:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:2.0:1787599473.769945:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+54:12325:x1874433559052160:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1787599473.770203:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.770220:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.770242:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599473.770291:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1787599473.770313:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f769b8c0 reply state 000000003d5a1b51 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.770325:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.770332:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599473.770335:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599473.770339:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599473.770430:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+57:12325:x1874433559052160:12345-192.168.202.1@tcp:36:bash.0 Request processed in 487us (822us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787599473.770437:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000020:00080000:2.0:1787599473.770441:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787599473.780192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.780348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559052288 00000100:00100000:0.0:1787599473.780359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559052288 00000100:00100000:0.0:1787599473.780415:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1787599473.780424:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+57:12325:x1874433559052288:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599473.780447:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599473.780466:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd65 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.780549:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.780562:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 58 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.780571:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.780612:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 58 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.780636:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 58 pid: 13004 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.780649:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577990528:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599473.780954:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599473.785048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.785776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559052416 00000100:00100000:2.0:1787599473.785836:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559052416 00010000:00010000:2.0:1787599473.785881:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 59 pid: 13004 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599473.785973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1787599473.785983:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:2404:x1874433559052416:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599473.785998:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599473.786005:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 59 pid: 13004 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.786019:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 59 pid: 13004 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.786040:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599473.786045:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.786055:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.786073:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.786092:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599473.786155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:2404:x1874433559052416:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 173us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599473.786162:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00010000:00010000:3.0:1787599473.786545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cfead lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd5e expref: 58 pid: 13004 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599473.786564:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577990528:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599473.786600:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.786609:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.786615:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599473.786678:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787599473.786682:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599473.786701:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.786729:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929cfec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd65 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.786744:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd65 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.786751:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599473.786754:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599473.786756:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4200, rc 0) 00000100:00100000:3.0:1787599473.786827:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+57:12325:x1874433559052288:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6368us (6609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599473.786834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1787599473.791149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.791237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559052672 00000100:00100000:3.0:1787599473.791247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559052672 00000100:00100000:3.0:1787599473.791303:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1787599473.791314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+57:12325:x1874433559052672:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:3.0:1787599473.791519:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12325:x1874433559052672:12345-192.168.202.1@tcp:35:bash.0 Request processed in 206us (379us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787599473.791527:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1787599473.883033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.883140:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559052928 00000100:00100000:2.0:1787599473.883151:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559052928 00000100:00100000:2.0:1787599473.883240:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:2.0:1787599473.883252:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12335:x1874433559052928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599473.883276:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599473.883295:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd6c expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599473.883398:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787599473.883511:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfed0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd6c expref: 60 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.883526:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:2.0:1787599473.883529:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599473.883534:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929cfed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd6c expref: 60 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599473.883548:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758a00, rc 0) 00000100:00100000:2.0:1787599473.883611:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12335:x1874433559052928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 361us (589us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1787599473.883619:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1787599473.886679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599473.886772:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559053056 00000100:00100000:0.0:1787599473.886782:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559053056 00000100:00100000:0.0:1787599473.886864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:0.0:1787599473.886873:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12335:x1874433559053056:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1787599473.886947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.886962:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.886972:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.886981:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.886988:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887006:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887116:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599473.887157:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887169:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887174:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887181:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887186:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599473.887190:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887197:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599473.887218:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599473.887223:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887230:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cfede lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887243:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887248:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887253:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887258:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599473.887261:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887267:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887274:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:0.0:1787599473.887276:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599473.887278:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887283:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cfee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887291:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887303:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887307:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887312:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599473.887314:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887319:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887325:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.887327:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599473.887329:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.887333:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5000/0x5d2988b0929cfeec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599473.887401:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12335:x1874433559053056:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 528us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599473.887408:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:0.0:1787599473.890202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.890299:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559053312 00000100:00100000:3.0:1787599473.890312:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559053312 00000100:00100000:3.0:1787599473.890383:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1787599473.890395:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12335:x1874433559053312:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599473.890640:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+60:12335:x1874433559053312:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 248us (449us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787599473.890647:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00010000:00010000:3.0:1787599473.894834:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599473.920664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.920751:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559053568 00000100:00100000:3.0:1787599473.920765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559053568 00000100:00100000:3.0:1787599473.920864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1787599473.920876:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+60:12338:x1874433559053568:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599473.920912:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599473.920936:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd73 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921015:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921046:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921058:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921081:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921088:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921095:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921191:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cff08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921200:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921207:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599473.921217:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787599473.921304:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921312:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921320:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921331:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599473.921336:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921344:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921355:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599473.921358:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599473.921363:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921370:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cfefa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921382:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921387:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921393:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921399:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599473.921401:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921407:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921420:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:3.0:1787599473.921423:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599473.921425:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921431:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921464:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfef3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd73 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921475:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cff08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd73 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.921481:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599473.921483:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599473.921486:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ca00, rc 0) 00000100:00100000:3.0:1787599473.921541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12338:x1874433559053568:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 668us (889us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787599473.921548:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:2.0:1787599473.925060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599473.925116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.925220:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559053696 00000100:00100000:3.0:1787599473.925240:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559053696 00000100:00100000:3.0:1787599473.925308:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:3.0:1787599473.925318:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12338:x1874433559053696:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1787599473.925386:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925401:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925424:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925458:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925465:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925471:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925476:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599473.925480:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925486:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925498:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599473.925501:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599473.925505:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599473.925510:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599473.925597:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12338:x1874433559053696:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 271us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599473.925605:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1787599473.926242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559053824 00000100:00100000:0.0:1787599473.926250:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559053824 00000100:00100000:0.0:1787599473.926298:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1787599473.926308:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+62:2404:x1874433559053824:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599473.926329:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599473.926347:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929cff08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd73 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599473.926361:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599473.926365:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599473.926407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+61:2404:x1874433559053824:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 99us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599473.926414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599473.929182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599473.929308:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559054080 00000100:00100000:3.0:1787599473.929318:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559054080 00000100:00100000:3.0:1787599473.929375:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1787599473.929386:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+61:12338:x1874433559054080:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599473.929599:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12338:x1874433559054080:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 214us (426us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787599473.929607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1787599474.048188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.048341:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559054336 00000100:00100000:2.0:1787599474.048351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559054336 00000100:00100000:2.0:1787599474.048423:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:2.0:1787599474.048436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12356:x1874433559054336:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1787599474.048478:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599474.048500:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cff1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd7a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.048621:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.048638:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.048650:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599474.048663:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787599474.049047:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929cff1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd7a expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.049078:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd7a expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.049088:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.049091:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787599474.049094:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599474.049168:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12356:x1874433559054336:12345-192.168.202.1@tcp:101:cat.0 Request processed in 734us (990us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787599474.049176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00080000:1.0:1787599474.049357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599474.070871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.071048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559054464 00000100:00100000:3.0:1787599474.071058:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559054464 00000100:00100000:3.0:1787599474.071128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1787599474.071140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12357:x1874433559054464:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599474.071167:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599474.071188:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd81 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071287:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071312:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599474.071352:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787599474.071356:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599474.071372:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071396:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd81 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071421:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd81 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.071429:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599474.071432:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599474.071435:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d400, rc 0) 00000100:00100000:3.0:1787599474.071496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12357:x1874433559054464:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 358us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.071504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:0.0:1787599474.077102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.077237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559054848 00000100:00100000:3.0:1787599474.077250:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559054848 00000100:00100000:3.0:1787599474.077317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1787599474.077328:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12357:x1874433559054848:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599474.077607:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12357:x1874433559054848:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 279us (515us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787599474.077615:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1787599474.080593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.080710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559054976 00000100:00100000:2.0:1787599474.080720:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559054976 00000100:00100000:2.0:1787599474.080822:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599474.080831:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12357:x1874433559054976:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:2.0:1787599474.080847:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787599474.080871:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cfec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd65 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.080892:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd7a expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.080903:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cfdc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd1f expref: 64 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.080913:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.080917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599474.080974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12357:x1874433559054976:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 144us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.080981:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599474.083209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.083341:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055104 00000100:00100000:0.0:1787599474.083351:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055104 00000100:00100000:0.0:1787599474.083403:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1787599474.083413:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12357:x1874433559055104:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1787599474.083527:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.083544:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.083554:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599474.083668:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787599474.083752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12357:x1874433559055104:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 339us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.083760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1787599474.103084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.103380:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055232 00000100:00100000:3.0:1787599474.103391:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055232 00000100:00100000:3.0:1787599474.103454:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:3.0:1787599474.103464:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12359:x1874433559055232:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599474.103485:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599474.103505:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd88 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103568:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103600:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103611:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103623:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103630:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103637:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103698:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103707:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103714:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599474.103751:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787599474.103755:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599474.103770:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103781:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103947:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103954:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103961:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103967:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599474.103971:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103978:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.103989:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599474.103992:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599474.103996:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104002:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929cff4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104013:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104019:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104025:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104035:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599474.104038:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104044:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104050:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:3.0:1787599474.104053:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599474.104055:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104072:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d200/0x5d2988b0929cff55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104097:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cff47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 65 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104110:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 64 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.104117:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599474.104120:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599474.104122:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c000, rc 0) 00000100:00100000:3.0:1787599474.104304:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12359:x1874433559055232:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 841us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.104312:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000040:00080000:0.0:1787599474.662858:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599474.662868:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599474.662893:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787599474.662902:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599474.663030:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577990656:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599474.663132:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599474.674952:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577990656:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599474.676969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.680927:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055360 00000100:00100000:2.0:1787599474.680941:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055360 00000100:00100000:2.0:1787599474.682461:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:2.0:1787599474.682477:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12371:x1874433559055360:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787599474.682509:0:13004:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787599474.682639:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12371:x1874433559055360:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 167us (5679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.682656:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:3.0:1787599474.693936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.694128:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055488 00000100:00100000:2.0:1787599474.694139:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055488 00000100:00100000:2.0:1787599474.694199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:2.0:1787599474.694210:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12371:x1874433559055488:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787599474.694292:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694308:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694320:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694373:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694381:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694387:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694409:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694417:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694424:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599474.694468:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787599474.694472:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599474.694483:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694494:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694500:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694507:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694513:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.694516:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694524:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694535:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599474.694539:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.694543:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694549:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929cff63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694560:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694588:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694595:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694600:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.694603:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694610:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694618:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff96b342bf1400) 00010000:00010000:2.0:1787599474.694621:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.694624:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694630:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929cff6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694644:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694651:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694656:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694660:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.694670:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694676:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694684:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.694687:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.694689:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.694695:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929cff71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.695679:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12371:x1874433559055488:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1466us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.695690:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1787599474.697755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.700473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055744 00000100:00100000:2.0:1787599474.700490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055744 00000100:00100000:2.0:1787599474.700544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1787599474.700555:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12371:x1874433559055744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599474.700674:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599474.700696:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd8f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.700866:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.700882:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.700894:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599474.700905:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787599474.701003:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701011:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701018:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701024:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.701028:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701035:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701046:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.701049:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599474.701063:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701069:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929cff7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701109:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd8f expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701120:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599474.701122:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599474.701126:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929cff78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd8f expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.701146:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758000, rc 0) 00000100:00100000:2.0:1787599474.701321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559055744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 667us (3473us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787599474.701330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1787599474.709396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.709500:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559055872 00000100:00100000:3.0:1787599474.709510:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559055872 00000100:00100000:3.0:1787599474.709676:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1787599474.709690:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559055872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599474.709726:0:13004:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599474.709875:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559055872:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 188us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.715559:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:1.0:1787599474.720369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.722898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559056128 00000100:00100000:2.0:1787599474.722914:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559056128 00000100:00100000:1.0:1787599474.724768:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:1.0:1787599474.724782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559056128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599474.724826:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599474.724829:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787599474.724858:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cff39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd81 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.724875:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599474.724880:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599474.724894:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cff8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd96 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599474.725328:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787599474.725478:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cff94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.725492:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cff94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.725502:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cff94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.725563:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929cff8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd96 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.725649:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cff94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd96 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.725658:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b370675e00) 00010000:00010000:1.0:1787599474.725660:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599474.725663:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152be00, rc 0) 00000100:00100000:1.0:1787599474.725724:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12371:x1874433559056128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 945us (5363us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787599474.725732:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:2.0:1787599474.729024:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.729253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577990784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599474.729333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599474.729410:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577990784 00000100:00100000:3.0:1787599474.729419:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577990784 00000100:00100000:3.0:1787599474.729473:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787599474.729482:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577990784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599474.729510:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787599474.729552:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577990784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.729559:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1787599474.729591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599474.729624:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577990784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599474.731438:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559056384 00000100:00100000:0.0:1787599474.731449:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559056384 00000100:00100000:0.0:1787599474.731503:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:0.0:1787599474.731512:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12371:x1874433559056384:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599474.731581:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599474.731611:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929cff94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd96 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731629:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b370675e00) 00010000:00010000:0.0:1787599474.731640:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599474.731662:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731676:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731686:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731701:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731708:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731724:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731765:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731771:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731777:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731782:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599474.731786:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731808:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731831:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599474.731834:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599474.731837:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731842:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929cffa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731850:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731855:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731866:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731871:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599474.731874:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731880:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731886:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x23126966 (ffff96b35acbba00) 00010000:00010000:0.0:1787599474.731889:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599474.731891:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.731896:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffa9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x23126966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.731971:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559056384:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 459us (2958us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599474.731979:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1787599474.736015:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577991040:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736147:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577991552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736196:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577992064:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736243:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787599474.736251:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577991168:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736298:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577991680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736319:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736334:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577992192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.736391:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991040 00000100:00100000:1.0:1787599474.736398:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991040 00000100:00100000:1.0:1787599474.736431:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991552 00000100:00100000:1.0:1787599474.736434:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991552 00000100:00100000:1.0:1787599474.736457:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992064 00000100:00100000:1.0:1787599474.736460:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992064 00000100:00100000:1.0:1787599474.736471:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991680 00000100:00100000:1.0:1787599474.736473:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991680 00000100:00100000:1.0:1787599474.736487:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787599474.736495:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577991040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736544:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433577991040:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.736552:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787599474.736570:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787599474.736577:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577991552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736604:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433577991552:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.736610:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787599474.736621:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787599474.736627:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577992064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736654:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433577992064:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.736659:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787599474.736670:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787599474.736676:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577991680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736700:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433577991680:12345-0@lo:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.736712:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1787599474.736731:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599474.736734:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787599474.736757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433adc00 x1874433577991680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599474.736771:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433577991680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736782:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433577991040:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.736789:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433577991552:0@lo:400:kworker.0 00010000:00080000:1.0:1787599474.736826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433af480 x1874433577992064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599474.736834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433577992064:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.737861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577991296:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.737905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.737943:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577991808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.737966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.737984:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577992320:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.738004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.738033:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787599474.738040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577990912:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.738077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.738099:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577991424:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.738122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.738136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577991936:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.738155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.738170:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577992448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599474.738204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.738288:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992192 00000100:00100000:1.0:1787599474.738294:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992192 00000100:00100000:1.0:1787599474.738346:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991808 00000100:00100000:1.0:1787599474.738349:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991808 00000100:00100000:1.0:1787599474.738362:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992320 00000100:00100000:1.0:1787599474.738365:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992320 00000100:00100000:1.0:1787599474.738377:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787599474.738384:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738430:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577992192:12345-0@lo:400:kworker.0 Request processed in 47us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738437:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787599474.738450:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599474.738456:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577991808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738494:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577991808:12345-0@lo:400:kworker.0 Request processed in 38us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738500:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599474.738511:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599474.738517:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738541:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577992320:12345-0@lo:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738547:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787599474.738563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577990912 00000100:00100000:1.0:1787599474.738567:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577990912 00000100:00100000:1.0:1787599474.738591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787599474.738597:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577990912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433577990912:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787599474.738667:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433577990912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577991808:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577992320:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738723:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577992192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738739:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991296 00000100:00100000:1.0:1787599474.738742:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991296 00000100:00100000:1.0:1787599474.738762:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991936 00000100:00100000:1.0:1787599474.738765:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991936 00000100:00100000:1.0:1787599474.738780:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787599474.738786:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577991296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738850:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433577991296:12345-0@lo:400:kworker.0 Request processed in 65us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738857:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787599474.738870:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787599474.738876:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738901:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577991936:12345-0@lo:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.738906:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787599474.738930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577991936:0@lo:400:kworker.0 00000100:00100000:1.0:1787599474.738940:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433577991296:0@lo:400:kworker.0 00000100:00080000:0.0:1787599474.740216:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599474.740225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599474.740228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599474.740310:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991168 00000100:00100000:2.0:1787599474.740318:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991168 00000100:00100000:2.0:1787599474.740363:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577991424 00000100:00100000:2.0:1787599474.740366:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577991424 00000100:00100000:2.0:1787599474.740382:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787599474.740390:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577991168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599474.740469:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433577991168:12345-0@lo:400:kworker.0 Request processed in 79us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.740475:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787599474.740490:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787599474.740496:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577991424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599474.740530:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577991424:12345-0@lo:400:kworker.0 Request processed in 35us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.740536:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787599474.740553:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992448 00000100:00100000:2.0:1787599474.740557:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992448 00000100:00100000:2.0:1787599474.740582:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599474.740588:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577992448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599474.740611:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787599474.740644:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433577992448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.740650:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787599474.740686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577991424:0@lo:400:kworker.0 00000100:00100000:2.0:1787599474.740705:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577992448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599474.743301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.743372:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559056512 00000100:00100000:0.0:1787599474.743381:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559056512 00000100:00100000:0.0:1787599474.743430:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1787599474.743441:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12371:x1874433559056512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599474.743460:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599474.743483:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cffb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbd9d expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743518:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743530:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743541:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743658:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cffb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 67 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743675:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.743684:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.743687:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599474.743691:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4000, rc 0) 00000100:00100000:0.0:1787599474.743750:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12371:x1874433559056512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 311us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.743757:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:1.0:1787599474.743876:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433577991168:0@lo:400:kworker.0 00000100:00100000:0.0:1787599474.748251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.748369:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559056768 00000100:00100000:3.0:1787599474.748382:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559056768 00000100:00100000:3.0:1787599474.748453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1787599474.748464:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12371:x1874433559056768:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787599474.748555:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.748577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.748591:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599474.748767:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787599474.748778:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421367984663ns, next at 422367982126ns, rc = 0 00000004:00010000:3.0:1787599474.748852:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2689463 reply state 0000000061281c2f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.748865:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.748873:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:3.0:1787599474.748876:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787599474.748879:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599474.748978:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12371:x1874433559056768:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 515us (737us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787599474.748986:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:2.0:1787599474.751532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.751605:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559056896 00000100:00100000:0.0:1787599474.751615:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559056896 00000100:00100000:0.0:1787599474.751675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1787599474.751686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12371:x1874433559056896:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599474.751716:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599474.751739:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbda4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.751829:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.751844:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.751881:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.751884:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599474.751888:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5c00, rc 0) 00000100:00100000:0.0:1787599474.751939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+69:12371:x1874433559056896:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 255us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.751946:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1787599474.754257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599474.754326:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559057024 00000100:00100000:1.0:1787599474.754336:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559057024 00000100:00100000:1.0:1787599474.754405:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1787599474.754415:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2403:x1874433559057024:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787599474.754635:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559057024:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 221us (387us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787599474.754643:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00080000:0.0:1787599474.755046:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599474.756384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.756448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559057280 00000100:00100000:3.0:1787599474.756455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559057280 00000100:00100000:3.0:1787599474.756501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1787599474.756511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+69:12371:x1874433559057280:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599474.756739:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12371:x1874433559057280:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 228us (362us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787599474.756755:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1787599474.775696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.775734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559057536 00000100:00100000:3.0:1787599474.775744:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559057536 00000100:00100000:3.0:1787599474.775809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1787599474.775821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12371:x1874433559057536:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787599474.775938:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12371:x1874433559057536:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.775946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000040:00080000:1.0:1787599474.776929:0:14611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599474.776936:0:14611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599474.776962:0:14611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787599474.776969:0:14611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599474.778123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.778165:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559057664 00000100:00100000:0.0:1787599474.778173:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559057664 00000100:00100000:0.0:1787599474.778231:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1787599474.778241:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12371:x1874433559057664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599474.778259:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599474.778280:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cffcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdab expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778345:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778360:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778370:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599474.778427:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599474.778447:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778471:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929cffcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdab expref: 72 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778488:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdab expref: 71 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.778498:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.778500:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787599474.778504:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4e00, rc 0) 00000100:00100000:0.0:1787599474.778549:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12371:x1874433559057664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 309us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.778557:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1787599474.787492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599474.787563:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559057792 00000100:00100000:1.0:1787599474.787582:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559057792 00000100:00100000:1.0:1787599474.787649:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1787599474.787659:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559057792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599474.787678:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599474.787697:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdb2 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599474.787722:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a72, blocks: 0x0 00010000:00010000:1.0:1787599474.787740:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787599474.787744:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599474.787754:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.787773:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.787787:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599474.787887:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559057792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 228us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.787894:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1787599474.790004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599474.790080:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058048 00000100:00100000:1.0:1787599474.790088:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058048 00000100:00100000:1.0:1787599474.790138:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:1.0:1787599474.790148:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12371:x1874433559058048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599474.790294:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12371:x1874433559058048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.790301:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:0.0:1787599474.796748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.797127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058176 00000100:00100000:3.0:1787599474.797139:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058176 00000100:00100000:3.0:1787599474.797198:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599474.797209:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:12371:x1874433559058176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599474.797287:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599474.797305:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdb9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.797336:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.797346:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599474.797350:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599474.797356:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.797403:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.797416:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 9 pid: 8433 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.797430:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874433577992576:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599474.797517:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599474.808092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.808126:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058304 00000100:00100000:3.0:1787599474.808134:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058304 00010000:00010000:3.0:1787599474.808217:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 10 pid: 8433 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.808262:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1787599474.808273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559058304:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599474.808288:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599474.808310:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 10 pid: 8433 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.808325:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 10 pid: 8433 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.808349:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599474.808361:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599474.808372:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.808382:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.808417:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.808431:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874433577992704:192.168.202.1@tcp:105: 00000100:00100000:3.0:1787599474.808507:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b4600 going to sleep for 11 seconds 00010000:00010000:1.0:1787599474.808723:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0de75a/0x5d2988b0929cffda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb2 expref: 10 pid: 8433 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.808739:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874433577992576:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599474.808765:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.808776:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d200, rc 0) 00000100:00100000:1.0:1787599474.808847:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+9:12371:x1874433559058176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 11639us (12106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.808855:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1787599474.819447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599474.819515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058432 00000100:00100000:1.0:1787599474.819525:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058432 00002000:00100000:1.0:1787599474.819587:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff96b2441b9180 x1874433559058432/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:330/0 lens 504/0 e 0 to 0 dl 1787599485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599474.819599:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2441b9180 with x1874433559058432 ext(0->8) 00002000:00010000:1.0:1787599474.819605:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2441b9180 00000100:00100000:1.0:1787599474.819639:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599474.819650:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559058432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787599474.820536:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2404:x1874433559058432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 884us (1096us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787599474.820546:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00100000:1.0:1787599474.820553:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff96b2441b9180 x1874433559058432/t4294967315(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:330/0 lens 504/448 e 0 to 0 dl 1787599485 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599474.820690:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2441b9180 with x1874433559058432 ext(0->8) 00002000:00010000:1.0:1787599474.820695:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2441b9180 00000100:00100000:3.0:1787599474.822507:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874433577992704:192.168.202.1@tcp:105: 00010000:00010000:3.0:1787599474.822528:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599474.822593:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559058304:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 14321us (14511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.822603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1787599474.828992:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.829312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058560 00000100:00100000:2.0:1787599474.829323:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058560 00000100:00100000:2.0:1787599474.829370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:2.0:1787599474.829379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12371:x1874433559058560:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787599474.841012:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787599474.841030:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787599474.841099:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787599474.841126:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b3469f4c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787599474.841132:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34629eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b3469f4f00 00000020:00080000:3.0:1787599474.841134:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b34629e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b243552a00 00000020:00080000:3.0:1787599474.841277:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787599474.841330:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787599474.841338:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599474.841364:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577992832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787599474.841433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.841554:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599474.841563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577992960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787599474.841601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599474.841631:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992832 00000100:00100000:1.0:1787599474.841637:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992832 00000100:00100000:1.0:1787599474.841676:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577992960 00000100:00100000:1.0:1787599474.841678:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577992960 00000100:00100000:1.0:1787599474.841698:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599474.841706:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577992832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787599474.841878:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787599474.841882:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787599474 00002000:00010000:1.0:1787599474.841885:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787599474.841888:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787599474 -> 1787599474 00002000:00010000:1.0:1787599474.841890:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787599474.841925:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577992832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (491us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787599474.841932:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599474.841951:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599474.841957:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433577992960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787599474.841971:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1787599474.842000:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c9a70, atime: 0x6a8c9a70, ctime: 0x6a8c9a70, blocks: 0x8 00010000:00010000:1.0:1787599474.842008:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.842035:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787599474.842040:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599474.842045:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.842071:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.842081:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.842089:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.842112:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599474.842173:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599474.842181:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.842189:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599474.842194:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.842208:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.842218:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874433577992960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 261us (616us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787599474.842223:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1787599474.842225:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.842231:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0de75a/0x5d2988b0929cffe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.842247:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599474.842249:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599474.842250:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787599474.842261:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2433ae680/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787599474.842267:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577992960:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1787599474.842444:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2443a2300/2, rc 0, transno 4294967316 00000100:00100000:3.0:1787599474.842450:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577992832:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787599474.843091:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843102:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843109:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843114:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843118:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843124:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843148:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96b342bf1800) 00010000:00010000:2.0:1787599474.843152:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843156:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843162:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929cfd09 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.843163:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12371:x1874433559058560:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 13782us (14177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.843171:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00010000:00010000:2.0:1787599474.843176:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843182:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843187:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843192:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843195:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843202:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843209:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599474.843211:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843214:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843228:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929cfd10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843245:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843249:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843252:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843255:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843257:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843260:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843265:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62100) 00010000:00010000:2.0:1787599474.843266:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843268:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843271:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929cfd4f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843280:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843283:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843287:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843293:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843295:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843298:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843303:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.843304:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843305:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843308:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929cfe52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843315:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843318:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843321:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843324:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843326:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843329:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843340:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.843342:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843344:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843348:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929cfe75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843354:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843358:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843362:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843364:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843366:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843369:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843373:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.843374:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599474.843375:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843378:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929cfebb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843390:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843394:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843397:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843400:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599474.843402:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843405:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843409:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:2.0:1787599474.843410:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599474.843411:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.843414:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929cffbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.848200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.848276:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058688 00000100:00100000:0.0:1787599474.848286:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058688 00000100:00100000:0.0:1787599474.848340:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1787599474.848350:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2406:x1874433559058688:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787599474.850044:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787599474.850068:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1787599474.850365:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559058688:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 2012us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.850376:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1787599474.852206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.852238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559058944 00000100:00100000:0.0:1787599474.852248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559058944 00000100:00100000:0.0:1787599474.852347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:0.0:1787599474.852358:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12371:x1874433559058944:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599474.852413:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599474.852439:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929cffd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdab expref: 19 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.852462:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.852467:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599474.852497:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.852510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.852520:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599474.852660:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0d75270 reply state 00000000eee356c9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.852672:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.852678:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.852680:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599474.852683:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599474.852780:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+20:12371:x1874433559058944:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 423us (583us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1787599474.852787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:3.0:1787599474.857690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.860782:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059072 00000100:00100000:2.0:1787599474.860830:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059072 00000100:00100000:2.0:1787599474.860896:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599474.860907:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559059072:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787599474.861097:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787599474.861101:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787599474 -> 1787599473 00002000:00010000:2.0:1787599474.861109:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787599472 00002000:00010000:2.0:1787599474.861111:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787599474 -> 1787599473 00002000:00010000:2.0:1787599474.861113:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787599474.861191:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559059072:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 284us (3508us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787599474.861200:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1787599474.864862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.865073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059328 00000100:00100000:3.0:1787599474.865084:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059328 00000100:00100000:3.0:1787599474.865134:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:3.0:1787599474.865143:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+20:12371:x1874433559059328:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787599474.865202:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.865214:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 20 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.865868:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.866086:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 20 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.866102:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 20 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599474.866118:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577993088:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599474.866236:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ec480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599474.868508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.868583:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059456 00000100:00100000:3.0:1787599474.868591:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059456 00010000:00010000:3.0:1787599474.868632:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 21 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.868676:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1787599474.868686:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+21:2404:x1874433559059456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599474.868707:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599474.868714:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 21 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.868728:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 21 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.868754:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:3.0:1787599474.868760:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.868771:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.868779:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.868817:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599474.868865:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+21:2404:x1874433559059456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599474.868873:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00010000:00010000:1.0:1787599474.869336:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929cffb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd9d expref: 20 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.869364:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577993088:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599474.869383:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869392:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869399:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869439:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869446:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869453:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869459:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599474.869464:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869472:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869484:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:1.0:1787599474.869487:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787599474.869490:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.869501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929cfff6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.869589:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12371:x1874433559059328:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 4445us (4737us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787599474.869598:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1787599474.876299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.876374:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059584 00000100:00100000:3.0:1787599474.876383:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059584 00000100:00100000:3.0:1787599474.876442:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1787599474.876453:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559059584:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787599474.876495:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.876516:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.876533:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599474.876538:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599474.876542:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.876579:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.876593:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 8 pid: 8436 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.876607:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577993216:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599474.876688:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599474.879430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.879508:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059712 00000100:00100000:0.0:1787599474.879518:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059712 00010000:00010000:0.0:1787599474.879558:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 9 pid: 8436 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.879613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1787599474.879623:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559059712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599474.879637:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599474.879663:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 9 pid: 8436 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.879676:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 9 pid: 8436 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.879703:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599474.879708:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599474.879713:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.879722:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.879744:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599474.879829:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559059712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 207us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.879837:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00010000:00010000:2.0:1787599474.879941:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a016121/0x5d2988b0929cffe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdb9 expref: 8 pid: 8436 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599474.879956:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577993216:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599474.879978:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.879988:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.879995:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880024:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880032:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880040:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880047:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599474.880052:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880074:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880087:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.880094:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f674cb5b/0x5d2988b0929cfffd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599474.880138:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559059584:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 3687us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.880146:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1787599474.887293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.887379:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559059968 00000100:00100000:3.0:1787599474.887389:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559059968 00000100:00100000:3.0:1787599474.887448:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:3.0:1787599474.887458:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12371:x1874433559059968:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787599474.887535:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.887552:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.887562:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.887604:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.887618:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 19 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.887633:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993344:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599474.887705:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599474.891153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599474.891217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060096 00000100:00100000:1.0:1787599474.891227:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060096 00010000:00010000:1.0:1787599474.891266:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.891310:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1787599474.891320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:2403:x1874433559060096:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599474.891336:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599474.891343:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.891356:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.891381:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:1.0:1787599474.891387:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.891398:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.891406:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.891437:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599474.891495:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:2403:x1874433559060096:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 176us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.891502:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00010000:00010000:0.0:1787599474.891693:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929cfe4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd42 expref: 19 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.891724:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993344:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599474.891747:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.891757:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.891764:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.892129:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.892142:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.892152:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.892185:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.892200:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 19 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.892213:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993472:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599474.892319:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b35ac73480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599474.901190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599474.903158:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993472:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599474.903195:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.907756:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060224 00000100:00100000:1.0:1787599474.907774:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060224 00010000:00010000:1.0:1787599474.908016:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599474.908079:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1787599474.908089:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+20:2404:x1874433559060224:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599474.908105:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599474.908112:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908126:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908149:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929cffc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbda4 expref: 20 pid: 6522 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908163:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:1.0:1787599474.908168:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908178:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908202:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599474.908301:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599474.908363:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:2404:x1874433559060224:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 276us (7188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599474.908370:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00010000:00010000:2.0:1787599474.908770:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.908780:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599474.908910:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787599474.909029:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1787599474.909073:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787599474.909142:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577993600:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787599474.909201:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599474.909243:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ec480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599474.909336:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577993600 00000100:00100000:0.0:1787599474.909343:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577993600 00000100:00100000:0.0:1787599474.909383:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787599474.909391:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577993600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787599474.909473:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577993600:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599474.909479:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787599474.909511:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787599474.909516:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2443a2300, transno 4294967316 00000100:00100000:0.0:1787599474.909530:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577993600:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787599474.909648:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1787599474.909686:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577993728:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787599474.909711:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599474.909727:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599474.909816:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577993728 00000100:00100000:0.0:1787599474.909821:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577993728 00000100:00100000:0.0:1787599474.909845:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787599474.909852:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1874433577993728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787599474.909933:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874433577993728:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (220us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787599474.909939:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787599474.909968:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2441b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874433577993728:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787599474.909996:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910010:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910017:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910023:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599474.910027:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910035:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910049:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599474.910052:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599474.910066:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d000b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910091:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910097:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910103:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910107:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599474.910115:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910121:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910129:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:0.0:1787599474.910131:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599474.910134:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929cff40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910177:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 22 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910185:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910207:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 22 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599474.910221:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 22 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599474.910232:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2441b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993856:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599474.910293:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599474.915830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599474.916954:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060352 00000100:00100000:3.0:1787599474.917213:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2441b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577993856:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599474.917238:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.917866:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599474.918068:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060352 00010000:00010000:2.0:1787599474.918110:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 23 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599474.918150:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1787599474.918160:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:2404:x1874433559060352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599474.918177:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599474.918184:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 23 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918198:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 23 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929cff5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbd88 expref: 23 pid: 10099 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918246:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:2.0:1787599474.918252:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918262:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918270:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599474.918301:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599474.918356:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2404:x1874433559060352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 196us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599474.918364:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00010000:00010000:3.0:1787599474.919817:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919833:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919843:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919848:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919853:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919865:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599474.919868:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919873:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919884:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599474.919886:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599474.919888:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d0012 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919901:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919904:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919908:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919911:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599474.919912:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919915:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919925:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b342bf1b00) 00010000:00010000:3.0:1787599474.919926:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599474.919928:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.919931:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0004 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599474.920116:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12371:x1874433559059968:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 32657us (32828us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787599474.920125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000020:00080000:3.0:1787599474.920130:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787599474.920142:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599474.920146:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599474.920694:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787599474.920703:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599474.929740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599474.930124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060608 00000100:00100000:3.0:1787599474.930136:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060608 00000100:00100000:3.0:1787599474.930194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1787599474.930205:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12371:x1874433559060608:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787599474.930479:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787599474.930513:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787599474.930545:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.930561:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.930572:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.930580:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.930604:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.930625:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931038:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599474.931141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:12371:x1874433559060608:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 935us (1409us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787599474.931150:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000020:00080000:3.0:1787599474.931156:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599474.931203:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599474.931209:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931216:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599474.931220:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931228:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931241:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:3.0:1787599474.931244:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599474.931249:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931255:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0019 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599474.931279:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599474.931281:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599474.931283:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599475.237863:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599475.237887:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577993984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599475.237960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599475.238236:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577993984 00000100:00100000:3.0:1787599475.238244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577993984 00000100:00100000:3.0:1787599475.238301:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787599475.238312:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433577993984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599475.238340:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787599475.238392:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433577993984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599475.238399:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787599475.241822:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577993984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599475.242165:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577994112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599475.242243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599475.242386:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577994112 00000100:00100000:3.0:1787599475.242394:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577994112 00000100:00100000:3.0:1787599475.242445:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787599475.242455:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577994112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599475.242487:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787599475.242538:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377d61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433577994112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599475.242546:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787599475.242895:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433577994112:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787599475.941272:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599476.262100:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599476.262124:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577994240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599476.262196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599476.262274:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577994240 00000100:00100000:1.0:1787599476.262282:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577994240 00000100:00100000:1.0:1787599476.262328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787599476.262338:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577994240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599476.262373:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787599476.262417:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577994240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599476.262437:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787599476.267417:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577994240:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787599476.911460:0:14663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599476.911470:0:14663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599476.911495:0:14663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787599476.911503:0:14663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787599476.964933:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599477.212302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.212534:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060864 00000100:00100000:0.0:1787599477.212545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060864 00000100:00100000:0.0:1787599477.212640:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:0.0:1787599477.212653:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+23:12389:x1874433559060864:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599477.212677:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599477.212701:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d0020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdc0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.212844:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929d0027 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.212858:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929d0027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.212869:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929d0027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599477.212880:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787599477.212971:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d0020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc0 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.212989:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929d0027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc0 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.213015:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599477.213018:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787599477.213022:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4800, rc 0) 00000100:00100000:0.0:1787599477.213096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12389:x1874433559060864:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 446us (803us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787599477.213104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00080000:1.0:1787599477.213432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599477.219948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599477.220040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559060992 00000100:00100000:1.0:1787599477.220050:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559060992 00000100:00100000:1.0:1787599477.220112:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:1.0:1787599477.220123:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12389:x1874433559060992:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1787599477.220206:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220233:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220246:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220253:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220259:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220329:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220347:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220354:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599477.220394:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220404:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220409:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220415:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220420:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599477.220425:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220431:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220443:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599477.220457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599477.220462:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220468:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0035 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220485:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220491:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220496:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220501:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599477.220504:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220509:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220516:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b370675d00) 00010000:00010000:1.0:1787599477.220518:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599477.220521:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220526:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d003c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220539:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220545:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220550:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220559:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599477.220562:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220567:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220574:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b370675900) 00010000:00010000:1.0:1787599477.220576:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599477.220579:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.220585:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599477.221166:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12389:x1874433559060992:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1043us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599477.221175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:3.0:1787599477.314083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.314118:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559061248 00000100:00100000:3.0:1787599477.314127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559061248 00000100:00100000:3.0:1787599477.314177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1787599477.314187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12392:x1874433559061248:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599477.314215:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599477.314234:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d004a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdc7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314304:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314319:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314329:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314345:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314352:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.314359:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323247:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323283:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599477.323296:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787599477.323399:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323407:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323414:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323420:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.323424:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323431:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.323443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599477.324326:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.324333:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324341:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324357:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324363:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324368:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324373:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.324395:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324402:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324412:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62000) 00010000:00010000:3.0:1787599477.324415:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.324418:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324425:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0058 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324488:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d004a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324504:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.324512:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:3.0:1787599477.324514:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599477.324517:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c000, rc 0) 00000100:00100000:3.0:1787599477.334093:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12392:x1874433559061248:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 19893us (20003us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787599477.334108:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1787599477.334292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.334351:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559061376 00000100:00100000:0.0:1787599477.334361:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559061376 00000100:00100000:0.0:1787599477.334408:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1787599477.334416:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12392:x1874433559061376:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1787599477.334486:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334502:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334513:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334545:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334551:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334558:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334564:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599477.334575:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334582:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334602:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:0.0:1787599477.334606:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599477.334610:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.334616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d006d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599477.334692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12392:x1874433559061376:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 277us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599477.334699:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:1.0:1787599477.350606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.353217:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559061632 00000100:00100000:0.0:1787599477.353230:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559061632 00000100:00100000:0.0:1787599477.353298:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1787599477.353309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12392:x1874433559061632:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599477.353927:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+28:12392:x1874433559061632:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 618us (3338us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787599477.353934:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599477.455296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.458225:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559061888 00000100:00100000:2.0:1787599477.458240:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559061888 00000100:00100000:2.0:1787599477.458365:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1787599477.458377:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+28:11915:x1874433559061888:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599477.458401:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599477.458422:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0074 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdce expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.458540:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.458555:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.458583:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.458960:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.458974:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 29 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599477.458988:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577994368:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599477.459151:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599477.463888:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10099:1874433577994368:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599477.463915:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599477.469583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.470188:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062016 00000100:00100000:0.0:1787599477.470209:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062016 00010000:00010000:0.0:1787599477.470252:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 30 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599477.470294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1787599477.470316:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+30:2404:x1874433559062016:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599477.470329:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599477.470335:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 30 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470348:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 30 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470368:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c000/0x5d2988b0929d005f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc7 expref: 30 pid: 6521 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470384:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:0.0:1787599477.470389:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470398:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470404:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.470435:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599477.470661:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.470669:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599477.470686:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787599477.470842:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0074 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 31 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.470859:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 30 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.470878:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.470881:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599477.470883:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599477.470934:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11915:x1874433559061888:12345-192.168.202.1@tcp:101:bash.0 Request processed in 12559us (15648us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787599477.470941:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:0.0:1787599477.471960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+29:2404:x1874433559062016:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1642us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599477.471969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1787599477.478222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.478346:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062144 00000100:00100000:0.0:1787599477.478356:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062144 00000100:00100000:0.0:1787599477.478411:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:0.0:1787599477.478422:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+29:11915:x1874433559062144:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599477.478466:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599477.478485:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdd5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478516:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929d0090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478529:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929d0090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929d0090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478653:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdd5 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478672:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929d0090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdd5 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.478680:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:0.0:1787599477.478683:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599477.478687:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4a00, rc 0) 00000100:00100000:0.0:1787599477.478750:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11915:x1874433559062144:12345-192.168.202.1@tcp:101:bash.0 Request processed in 329us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599477.478757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:1.0:1787599477.485286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.485382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062400 00000100:00100000:2.0:1787599477.485392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062400 00000100:00100000:2.0:1787599477.485461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:2.0:1787599477.485472:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:11915:x1874433559062400:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1787599477.485699:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.485717:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.485729:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599477.485768:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1787599477.485840:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1dfaf44 reply state 000000009935f796 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.485854:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.485861:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.485864:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599477.485880:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787599477.485919:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1787599477.486013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+34:11915:x1874433559062400:12345-192.168.202.1@tcp:36:bash.0 Request processed in 542us (736us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787599477.486021:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000020:00080000:2.0:1787599477.486026:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787599477.487928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.488065:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062528 00000100:00100000:2.0:1787599477.488073:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062528 00000100:00100000:2.0:1787599477.488122:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:2.0:1787599477.488131:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+34:11915:x1874433559062528:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599477.488150:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599477.488167:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d009e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbddc expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.488223:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d009e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbddc expref: 35 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.488236:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d009e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbddc expref: 35 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.488254:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.488258:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599477.488261:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759e00, rc 0) 00000100:00100000:2.0:1787599477.488308:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+35:11915:x1874433559062528:12345-192.168.202.1@tcp:101:bash.0 Request processed in 177us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.488315:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:3.0:1787599477.490408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.490573:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062656 00000100:00100000:2.0:1787599477.490581:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062656 00000100:00100000:2.0:1787599477.490687:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1787599477.490702:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:11915:x1874433559062656:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599477.490716:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599477.490732:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbde3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599477.490753:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c9a71, atime: 0x6a8c9a70, ctime: 0x6a8c9a71, blocks: 0x8 00010000:00010000:2.0:1787599477.490769:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1787599477.490788:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599477.491533:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.491563:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.491575:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758c00, rc 0) 00000100:00100000:2.0:1787599477.491634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:11915:x1874433559062656:12345-192.168.202.1@tcp:101:bash.0 Request processed in 932us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.491641:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00080000:1.0:1787599477.501681:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599477.502429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.502556:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062784 00000100:00100000:0.0:1787599477.502567:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062784 00002000:00010000:0.0:1787599477.502608:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787599477.502613:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2433adc00 with x1874433559062784 ext(0->18446744073709551615) 00002000:00010000:0.0:1787599477.502639:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2433adc00. 00000100:00100000:0.0:1787599477.502673:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1787599477.502684:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2406:x1874433559062784:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:0.0:1787599477.503263:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787599477.503267:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787599473 -> 1787599477 00002000:00010000:0.0:1787599477.503270:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787599472 -> 1787599472 00002000:00010000:0.0:1787599477.503272:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787599473 -> 1787599477 00002000:00010000:0.0:1787599477.503274:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787599477.503373:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2406:x1874433559062784:12345-192.168.202.1@tcp:10:bash.0 Request processed in 690us (948us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787599477.503381:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00010000:0.0:1787599477.503386:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787599477.503388:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2433adc00 with x1874433559062784 ext(0->18446744073709551615) 00002000:00010000:0.0:1787599477.503393:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2433adc00. 00000100:00100000:0.0:1787599477.599549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.600704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559062912 00000100:00100000:3.0:1787599477.600716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559062912 00000100:00100000:3.0:1787599477.602414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1787599477.602431:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+35:12406:x1874433559062912:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1787599477.602511:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602529:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602540:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602554:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602562:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602569:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602649:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602658:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602665:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599477.602709:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602734:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602741:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602748:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602753:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.602769:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602784:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602811:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599477.602815:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.602820:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602826:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602840:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602845:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602851:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602861:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.602865:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602871:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602880:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62000) 00010000:00010000:3.0:1787599477.602882:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.602885:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602905:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602911:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602918:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602923:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.602926:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602932:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602953:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:3.0:1787599477.602956:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.602959:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.602964:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599477.603058:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+35:12406:x1874433559062912:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 632us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599477.603067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1787599477.660437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.660788:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559063168 00000100:00100000:0.0:1787599477.660836:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559063168 00000100:00100000:0.0:1787599477.660906:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:0.0:1787599477.660917:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+35:12409:x1874433559063168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599477.660942:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599477.660963:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d00c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdea expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.661057:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.661073:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.661099:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661185:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661196:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661218:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661322:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d00d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661331:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d00d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661339:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d00d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599477.661349:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787599477.661437:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661445:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661452:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661458:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599477.661462:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661469:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661481:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599477.661485:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599477.661495:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661500:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d00c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661514:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661519:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661525:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661529:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599477.661531:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661536:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661543:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b370675900) 00010000:00010000:1.0:1787599477.661558:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599477.661561:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661566:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d00cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661609:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d00c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdea expref: 38 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661637:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d00d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdea expref: 37 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.661644:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:1.0:1787599477.661646:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787599477.661648:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599477.661715:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12409:x1874433559063168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 800us (1288us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787599477.661723:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:1.0:1787599477.672260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.672380:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559063296 00000100:00100000:0.0:1787599477.672389:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559063296 00000100:00100000:0.0:1787599477.672450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:0.0:1787599477.672461:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12409:x1874433559063296:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1787599477.672528:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.672544:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 37 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.672555:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.672603:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 37 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599477.672625:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 37 pid: 10099 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599477.672643:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577994496:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599477.672746:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3534996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599477.676748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.676882:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2441b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577994496:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599477.676909:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599477.679902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559063552 00000100:00100000:1.0:1787599477.679917:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559063552 00000100:00100000:1.0:1787599477.680001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599477.680011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+38:6645:x1874433559063552:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599477.680938:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+39:6645:x1874433559063552:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 923us (4194us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787599477.680947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599477.683901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.683999:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559063680 00000100:00100000:2.0:1787599477.684009:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559063680 00010000:00010000:2.0:1787599477.684062:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 39 pid: 10099 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599477.684102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:2.0:1787599477.684112:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+39:2404:x1874433559063680:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599477.684127:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599477.684149:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 39 pid: 10099 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684162:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 39 pid: 10099 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684183:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d007b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdce expref: 39 pid: 10099 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684209:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.684214:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684224:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684231:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.684259:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599477.684379:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684388:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684423:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684429:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684435:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684461:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.684465:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684472:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684482:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:3.0:1787599477.684485:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599477.684488:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.684494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d00e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599477.684718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+38:2404:x1874433559063680:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 607us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.684726:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1787599477.686948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12409:x1874433559063296:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 14482us (14689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599477.686961:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:3.0:1787599477.694221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.694399:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559063936 00000100:00100000:0.0:1787599477.694409:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559063936 00000100:00100000:0.0:1787599477.694518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1787599477.694535:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+37:12409:x1874433559063936:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599477.698813:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+38:12409:x1874433559063936:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 4249us (4574us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787599477.698827:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1787599477.711853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.711882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.711916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599477.711942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064064 00000100:00100000:0.0:1787599477.711951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064064 00000100:00100000:2.0:1787599477.712153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064192 00000100:00100000:2.0:1787599477.712158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064192 00000100:00100000:2.0:1787599477.712205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064448 00000100:00100000:2.0:1787599477.712208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064448 00000100:00100000:2.0:1787599477.712231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:2.0:1787599477.712240:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559064192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599477.712313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559064192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.712332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:2.0:1787599477.712349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:2.0:1787599477.712355:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559064448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599477.712379:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559064448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.712384:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00080000:2.0:1787599477.712400:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599477.712404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599477.712429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.712490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.712565:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064320 00000100:00100000:2.0:1787599477.712569:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064320 00000100:00100000:2.0:1787599477.712598:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1787599477.712603:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559064320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599477.712642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2405:x1874433559064320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.712648:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00080000:2.0:1787599477.712664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599477.712688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064576 00000100:00100000:2.0:1787599477.712691:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064576 00000100:00100000:2.0:1787599477.712715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:2.0:1787599477.712720:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559064576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599477.712747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559064576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.712753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00080000:2.0:1787599477.712773:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599477.718674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 389 00000100:00100000:0.0:1787599477.718699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559064064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599477.718783:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559064064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (6865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599477.718806:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 389 00000100:00100000:2.0:1787599477.797577:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599477.797610:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2441b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577994624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599477.797691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599477.797864:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577994624 00000100:00100000:0.0:1787599477.797874:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577994624 00000100:00100000:0.0:1787599477.797929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787599477.797940:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577994624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599477.797983:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599477.798059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433577994624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599477.798067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787599477.798298:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2441b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433577994624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599477.817307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.817403:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559064832 00000100:00100000:3.0:1787599477.817414:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559064832 00000100:00100000:3.0:1787599477.817475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:3.0:1787599477.817485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+38:12420:x1874433559064832:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1787599477.817511:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599477.817531:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdf1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817632:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817647:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817658:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817673:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817680:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817686:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817819:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929d0100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929d0100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817836:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929d0100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599477.817845:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787599477.817917:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817924:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817937:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817943:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.817947:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817955:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599477.817970:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.817974:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817980:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d00f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817993:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.817998:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818004:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818009:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.818012:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818039:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818049:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b242e62000) 00010000:00010000:3.0:1787599477.818052:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.818055:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818061:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d00f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818103:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d00eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf1 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818117:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929d0100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf1 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.818124:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:3.0:1787599477.818127:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599477.818129:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599477.818196:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12420:x1874433559064832:12345-192.168.202.1@tcp:101:cat.0 Request processed in 712us (899us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787599477.818202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1787599477.826277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599477.826558:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065088 00000100:00100000:1.0:1787599477.826570:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065088 00000100:00100000:1.0:1787599477.826629:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599477.826640:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+40:12420:x1874433559065088:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1787599477.826954:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+41:12420:x1874433559065088:12345-192.168.202.1@tcp:35:cat.0 Request processed in 314us (685us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787599477.826980:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599477.860783:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.861060:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065344 00000100:00100000:2.0:1787599477.861071:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065344 00000100:00100000:2.0:1787599477.861131:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:2.0:1787599477.861142:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+41:12421:x1874433559065344:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1787599477.861212:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787599477.861238:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d009e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbddc expref: 41 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861260:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c400/0x5d2988b0929d0100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf1 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861274:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d00d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdea expref: 39 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861287:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4a00/0x5d2988b0929d0090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdd5 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861298:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.861303:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599477.861324:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861336:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861361:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861376:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861383:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861390:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861471:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861478:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861485:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599477.861701:0:10099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787599477.861711:0:10099:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424480918122ns, next at 425480915726ns, rc = 0 00010000:00010000:2.0:1787599477.861756:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861765:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861772:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861852:0:10099:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861860:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861866:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861889:0:10099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599477.861907:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861913:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861919:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861925:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599477.861930:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861936:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861945:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:2.0:1787599477.861947:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787599477.861951:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861966:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d011c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861982:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861988:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861993:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.861998:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599477.862001:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.862007:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.862016:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599477.862018:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599477.862021:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.862035:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d010e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599477.862045:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004339eaf0 reply state 00000000a4e0fb28 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.862055:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.862068:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:2.0:1787599477.862070:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599477.862073:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599477.862142:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+39:12421:x1874433559065344:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1001us (1366us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787599477.862150:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00010000:00010000:1.0:1787599477.863109:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599477.863118:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.863125:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599477.863129:0:10398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.863137:0:10398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.863147:0:10398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:1.0:1787599477.863149:0:10398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787599477.863152:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.863157:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0123 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.863168:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599477.863169:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599477.863171:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599477.927486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.927579:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065600 00000100:00100000:3.0:1787599477.927589:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065600 00000100:00100000:3.0:1787599477.927648:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:3.0:1787599477.927658:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+39:12427:x1874433559065600:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599477.927709:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599477.927729:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d012a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdf8 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927856:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927868:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927876:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927882:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927887:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.927890:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599477.928180:0:13004:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787599477.928436:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928443:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928448:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928481:0:13004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928486:0:13004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928491:0:13004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928494:0:13004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599477.928497:0:13004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928501:0:13004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928510:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:3.0:1787599477.928512:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599477.928515:0:13004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928521:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0131 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599477.928534:0:13004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f52e59a6 reply state 00000000f8d4563b transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928723:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928727:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:3.0:1787599477.928734:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599477.928736:0:13004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787599477.928865:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d012a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 42 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928876:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 41 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.928881:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:3.0:1787599477.928883:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599477.928884:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599477.928977:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+42:12427:x1874433559065600:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1320us (1499us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787599477.928984:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:2.0:1787599477.932456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599477.932528:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065728 00000100:00100000:3.0:1787599477.932537:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065728 00000100:00100000:3.0:1787599477.932671:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1787599477.932682:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559065728:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599477.932696:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599477.932712:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbdff expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599477.932732:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599477.932755:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1787599477.932759:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599477.932765:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.933183:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599477.933204:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d200, rc 0) 00000100:00100000:3.0:1787599477.933272:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2406:x1874433559065728:12345-192.168.202.1@tcp:101:bash.0 Request processed in 591us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599477.933278:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1787599477.935262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599477.935351:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065856 00000100:00100000:2.0:1787599477.935357:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065856 00000100:00100000:2.0:1787599477.935397:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1787599477.935403:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:12427:x1874433559065856:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599477.935414:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599477.935425:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe06 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.935444:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.935449:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599477.935452:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599477.935455:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.935478:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.935510:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 9 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599477.935522:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577994752:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599477.935618:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599477.938914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599477.938998:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559065984 00000100:00100000:1.0:1787599477.939007:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559065984 00010000:00010000:1.0:1787599477.939053:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 10 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599477.939111:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:1.0:1787599477.939120:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559065984:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599477.939136:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599477.939156:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 10 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.939170:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 10 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.939203:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599477.939208:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599477.939216:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.939226:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599477.939265:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599477.939278:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874433577994880:192.168.202.1@tcp:105: 00000100:00100000:1.0:1787599477.939358:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381b52b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787599477.940013:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a016121/0x5d2988b0929d014d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdff expref: 10 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599477.940038:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874433577994752:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599477.940062:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599477.940073:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599477.940117:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:12427:x1874433559065856:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4712us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599477.940125:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1787599477.948333:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f858e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1874433577994880:192.168.202.1@tcp:105: 00010000:00010000:1.0:1787599477.948371:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599477.948418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559065984:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 9299us (9513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599477.948427:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1787599477.950104:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599477.950181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559066240 00000100:00100000:1.0:1787599477.950189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559066240 00000100:00100000:1.0:1787599477.950273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1787599477.950280:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+42:12427:x1874433559066240:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1787599477.950612:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12427:x1874433559066240:12345-192.168.202.1@tcp:35:bash.0 Request processed in 330us (513us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787599477.950620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00010000:00010000:3.0:1787599477.989018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599478.158678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.158879:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559066368 00000100:00100000:2.0:1787599478.158890:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559066368 00000100:00100000:2.0:1787599478.158953:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1787599478.158964:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+43:12443:x1874433559066368:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599478.158987:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599478.159008:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d015b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe0d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159117:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159143:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599478.159186:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787599478.159299:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599478.159322:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159348:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d015b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe0d expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159366:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe0d expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.159376:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599478.159379:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599478.159382:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759400, rc 0) 00000100:00100000:2.0:1787599478.160184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+44:12443:x1874433559066368:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1219us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.160326:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1787599478.165664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599478.166033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559066624 00000100:00100000:3.0:1787599478.166044:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559066624 00000100:00100000:3.0:1787599478.166101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:3.0:1787599478.166112:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+44:12443:x1874433559066624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599478.166132:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599478.166152:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0169 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe14 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.166459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.166474:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.166485:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599478.166496:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787599478.166833:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d0169 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe14 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.166854:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe14 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.166863:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:3.0:1787599478.166866:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599478.166869:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:3.0:1787599478.166932:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+46:12443:x1874433559066624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 821us (1277us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787599478.166940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:3.0:1787599478.169974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.170168:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559066880 00000100:00100000:1.0:1787599478.170179:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559066880 00000100:00100000:1.0:1787599478.170244:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:1.0:1787599478.170255:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+46:12443:x1874433559066880:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599478.170277:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599478.170297:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d017e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe1b expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.170392:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.170405:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.170417:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599478.170460:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787599478.170564:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d017e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe1b expref: 49 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.170584:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe1b expref: 48 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.170592:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:1.0:1787599478.170595:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787599478.170600:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599478.170677:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+48:12443:x1874433559066880:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 422us (710us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1787599478.170684:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:3.0:1787599478.171347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.176990:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067008 00000100:00100000:2.0:1787599478.177722:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067008 00000100:00100000:2.0:1787599478.177947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599478.177959:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+48:2404:x1874433559067008:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599478.177976:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599478.178001:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200c800/0x5d2988b0929d0170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe14 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.178047:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:2.0:1787599478.178052:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599478.178120:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+47:2404:x1874433559067008:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 164us (6775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.178128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1787599478.186401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599478.187056:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067136 00000100:00100000:3.0:1787599478.187067:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067136 00000100:00100000:3.0:1787599478.187130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1787599478.187142:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2405:x1874433559067136:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1787599478.187188:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.187222:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.187232:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599478.187237:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599478.187242:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.187292:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.187308:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 8 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599478.187323:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874433577995008:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599478.187413:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599478.191075:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874433577995008:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599478.191105:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599478.192043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599478.192260:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067264 00000100:00100000:3.0:1787599478.192270:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067264 00002000:00100000:3.0:1787599478.192319:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff96b377afed80 x1874433559067264/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:334/0 lens 504/0 e 0 to 0 dl 1787599489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787599478.192330:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b377afed80 with x1874433559067264 ext(0->8) 00010000:00010000:3.0:1787599478.192337:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.192351:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599478.192358:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b377afed80 00000100:00100000:3.0:1787599478.192396:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1787599478.192406:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2403:x1874433559067264:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:3.0:1787599478.193643:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2403:x1874433559067264:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1234us (1600us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787599478.193653:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:3.0:1787599478.193661:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff96b377afed80 x1874433559067264/t4294967309(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:334/0 lens 504/448 e 0 to 0 dl 1787599489 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787599478.193671:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b377afed80 with x1874433559067264 ext(0->8) 00010000:00010000:3.0:1787599478.193678:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 11 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.193692:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 11 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599478.193701:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96b377afed80 00000001:00080000:2.0:1787599478.198234:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787599478.198255:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787599478.202757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.205263:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067392 00000100:00100000:1.0:1787599478.205277:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067392 00010000:00010000:1.0:1787599478.205327:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599478.205425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1787599478.205435:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559067392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599478.205450:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787599478.205467:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787599478.205470:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787599478 00002000:00010000:1.0:1787599478.205472:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787599478 00002000:00010000:1.0:1787599478.205474:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787599478 00002000:00010000:1.0:1787599478.205476:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787599478.205495:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.205508:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.205529:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d672467/0x5d2988b0929d0154 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe06 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.205545:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599478.205550:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599478.205556:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.205566:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.205605:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599478.205659:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+6:2404:x1874433559067392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 225us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.205668:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00010000:00010000:0.0:1787599478.205725:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205734:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205751:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205759:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205767:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205773:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599478.205777:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205786:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205825:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.205833:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d0193 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599478.205886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2405:x1874433559067136:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 18747us (19495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.205894:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1787599478.210296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599478.210378:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067648 00000100:00100000:3.0:1787599478.210389:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067648 00000100:00100000:3.0:1787599478.210451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1787599478.210462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+47:12443:x1874433559067648:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:3.0:1787599478.210528:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe1b expref: 47 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599478.210710:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1787599478.210743:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787599478.212387:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787599478.212432:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.212462:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 51 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.212471:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.212508:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 51 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.212535:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 51 pid: 13004 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599478.212767:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874433577995136:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599478.212894:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599478.215367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.215845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067776 00000100:00100000:0.0:1787599478.215854:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067776 00000100:00100000:2.0:1787599478.215870:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874433577995136:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599478.215889:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 52 pid: 13004 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.215890:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599478.215919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1787599478.215929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+52:2404:x1874433559067776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599478.215943:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599478.215950:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 52 pid: 13004 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.215961:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 52 pid: 13004 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.216174:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d013f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdf8 expref: 52 pid: 13004 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.216190:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:0.0:1787599478.216195:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.216203:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.216224:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.216255:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599478.216309:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+51:2404:x1874433559067776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 380us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.216317:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00010000:00010000:2.0:1787599478.216488:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.216496:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599478.216594:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1787599478.216702:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787599478.216780:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577995264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787599478.216955:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599478.217111:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599478.221392:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577995264 00000100:00100000:1.0:1787599478.221407:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577995264 00000100:00100000:0.0:1787599478.223185:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787599478.223201:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577995264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787599478.223340:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577995264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (6385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.223348:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787599478.223435:0:6523:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1787599478.223454:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1787599478.223474:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2433ae680, transno 4294967308 00000100:00100000:3.0:1787599478.223496:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577995264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599478.223634:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787599478.223702:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577995392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787599478.223740:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599478.223763:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599478.226241:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577995392 00000100:00100000:1.0:1787599478.226256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577995392 00000100:00100000:1.0:1787599478.226326:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787599478.226336:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874433577995392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787599478.226557:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1874433577995392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 222us (2815us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787599478.226591:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:2.0:1787599478.226665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599478.226730:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874433577995392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599478.226821:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1787599478.226874:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226885:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226893:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226899:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599478.226904:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226911:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226928:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:3.0:1787599478.226931:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787599478.226936:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599478.226953:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d019a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599478.227211:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787599478.227272:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787599478.227283:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424846489486ns, next at 425846487248ns, rc = 0 00000001:00080000:3.0:1787599478.227289:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1787599478.227311:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b242e62000) 00010000:00010000:3.0:1787599478.227314:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599478.227321:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0185 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe1b expref: 55 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599478.227409:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+54:12443:x1874433559067648:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 16948us (17124us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787599478.227418:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000020:00080000:3.0:1787599478.227421:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787599478.236277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.236717:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559067904 00000100:00100000:0.0:1787599478.236727:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559067904 00000100:00100000:0.0:1787599478.236790:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1787599478.236836:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+54:12443:x1874433559067904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599478.236862:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599478.236883:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d01a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe22 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.236941:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d01a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe22 expref: 55 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.236955:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d01a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe22 expref: 55 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.236993:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.236996:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599478.237000:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5400, rc 0) 00000100:00100000:0.0:1787599478.237908:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+55:12443:x1874433559067904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1072us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.237917:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:1.0:1787599478.240893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.243131:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559068160 00000100:00100000:0.0:1787599478.243145:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559068160 00000100:00100000:0.0:1787599478.243216:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1787599478.243227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+55:12443:x1874433559068160:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599478.247219:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+56:12443:x1874433559068160:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 3980us (6320us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787599478.247234:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1787599478.363669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.363864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559068288 00000100:00100000:2.0:1787599478.363879:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559068288 00000100:00100000:2.0:1787599478.363960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1787599478.363971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+56:12453:x1874433559068288:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1787599478.364072:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364094:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364127:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364140:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364149:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364155:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364242:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364251:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364259:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599478.364303:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364315:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364322:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364329:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364344:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599478.364348:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364356:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364368:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599478.364371:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599478.364375:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364382:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d01a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364395:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364402:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364408:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364413:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599478.364416:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364422:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364440:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:2.0:1787599478.364442:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599478.364446:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364452:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d01af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364461:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364468:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364473:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364477:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599478.364480:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364485:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364492:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:2.0:1787599478.364495:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599478.364498:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.364504:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758200/0x5d2988b0929d01b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599478.364596:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+56:12453:x1874433559068288:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 627us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.364604:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1787599478.431355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.431467:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559068544 00000100:00100000:0.0:1787599478.431478:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559068544 00000100:00100000:0.0:1787599478.431536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:0.0:1787599478.431556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+56:12456:x1874433559068544:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599478.431576:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599478.431598:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d01bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe29 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431682:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431698:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431725:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431736:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431744:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.431751:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432075:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d01d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432084:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d01d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432091:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d01d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599478.432100:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787599478.432175:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432183:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432334:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432341:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599478.432351:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432358:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432370:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599478.432373:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599478.432378:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432383:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d01c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432397:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432403:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432409:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432415:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599478.432418:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.432430:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:0.0:1787599478.433131:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599478.433144:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.433152:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d01cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.433204:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d01bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe29 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.433219:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d01d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe29 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.433226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.433229:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599478.433231:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4e00, rc 0) 00000100:00100000:0.0:1787599478.433296:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12456:x1874433559068544:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1743us (1949us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787599478.433304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:0.0:1787599478.439078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.441647:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559068672 00000100:00100000:1.0:1787599478.441663:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559068672 00000100:00100000:1.0:1787599478.441736:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:1.0:1787599478.441748:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12456:x1874433559068672:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1787599478.441970:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.441987:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.441999:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442045:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442052:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442058:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442064:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ae00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599478.442068:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442075:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442105:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.442108:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599478.442114:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.442121:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599478.442555:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12456:x1874433559068672:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 808us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.442564:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:3.0:1787599478.447374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.447501:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559068928 00000100:00100000:0.0:1787599478.447511:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559068928 00000100:00100000:0.0:1787599478.447585:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1787599478.447595:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+58:12456:x1874433559068928:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599478.447854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2441b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12456:x1874433559068928:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 259us (489us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787599478.447862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1787599478.559736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.559842:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559069184 00000100:00100000:1.0:1787599478.559853:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559069184 00000100:00100000:1.0:1787599478.559917:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:1.0:1787599478.559928:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+59:12466:x1874433559069184:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599478.559951:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599478.559954:0:13004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787599478.559979:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759400/0x5d2988b0929d0162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe0d expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.559997:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599478.560013:0:13004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599478.560035:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe30 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.560130:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d01ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.560156:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d01ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.560167:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d01ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599478.560178:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787599478.560291:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d01e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe30 expref: 61 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.560306:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d01ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe30 expref: 60 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.560314:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.560316:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599478.560319:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ac00, rc 0) 00000100:00100000:1.0:1787599478.560376:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+60:12466:x1874433559069184:12345-192.168.202.1@tcp:101:bash.0 Request processed in 450us (650us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787599478.560384:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:3.0:1787599478.563016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.563155:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559069312 00000100:00100000:0.0:1787599478.563175:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559069312 00000100:00100000:0.0:1787599478.563246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1787599478.563256:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+60:12466:x1874433559069312:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599478.563277:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599478.563294:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d01fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe37 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563327:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563339:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563351:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563444:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d01fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563462:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.563472:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.563475:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599478.563478:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4000, rc 0) 00000100:00100000:0.0:1787599478.563528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+61:12466:x1874433559069312:12345-192.168.202.1@tcp:101:bash.0 Request processed in 274us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.563536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:3.0:1787599478.566293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.567472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559069440 00000100:00100000:1.0:1787599478.567485:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559069440 00000100:00100000:1.0:1787599478.567549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1787599478.567560:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351f58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+61:2403:x1874433559069440:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599478.567573:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599478.567595:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d01ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe30 expref: 61 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.567641:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.567646:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599478.567700:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351f58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+60:2403:x1874433559069440:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 141us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.567706:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1787599478.569437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.569502:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559069696 00000100:00100000:0.0:1787599478.569509:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559069696 00000100:00100000:0.0:1787599478.569573:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1787599478.569583:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+60:12466:x1874433559069696:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1787599478.569646:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599478.569666:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d01d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe29 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.569682:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.569686:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599478.570103:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.570118:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.570127:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599478.570168:0:10099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787599478.570286:0:10099:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a28c15d reply state 000000008a89247c transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.570299:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.570306:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.570309:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599478.570311:0:10099:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599478.570392:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12466:x1874433559069696:12345-192.168.202.1@tcp:36:bash.0 Request processed in 810us (960us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787599478.570400:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000020:00080000:0.0:1787599478.570412:0:10099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787599478.574248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.574322:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559069824 00000100:00100000:0.0:1787599478.574330:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559069824 00000100:00100000:0.0:1787599478.574378:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1787599478.574387:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+62:12466:x1874433559069824:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599478.574409:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599478.574428:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0211 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe3e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574511:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574525:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574535:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599478.574576:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787599478.574580:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599478.574598:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574633:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0211 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574652:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599478.574661:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599478.574675:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599478.574678:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4200, rc 0) 00000100:00100000:0.0:1787599478.574730:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12466:x1874433559069824:12345-192.168.202.1@tcp:101:bash.0 Request processed in 343us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599478.574737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:3.0:1787599478.579217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599478.579329:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070080 00000100:00100000:0.0:1787599478.579338:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070080 00000100:00100000:0.0:1787599478.579388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1787599478.579399:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+63:12466:x1874433559070080:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:0.0:1787599478.579616:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12466:x1874433559070080:12345-192.168.202.1@tcp:35:bash.0 Request processed in 210us (398us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787599478.579624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1787599478.689488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.689587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070208 00000100:00100000:2.0:1787599478.689596:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070208 00000100:00100000:2.0:1787599478.689664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:2.0:1787599478.689674:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+64:12472:x1874433559070208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599478.689696:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599478.689716:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d021f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689777:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689840:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689853:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599478.689893:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787599478.689897:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599478.689915:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689939:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d021f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe45 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689975:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe45 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.689984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:2.0:1787599478.689987:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599478.689991:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759c00, rc 0) 00000100:00100000:2.0:1787599478.690059:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559070208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 386us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.690065:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:3.0:1787599478.694727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.696509:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070336 00000100:00100000:1.0:1787599478.696522:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070336 00000100:00100000:1.0:1787599478.696596:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:1.0:1787599478.696606:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559070336:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599478.696625:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599478.696644:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d022d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe4c expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696710:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696724:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696734:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696745:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696751:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696772:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696887:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696897:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696904:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599478.696943:0:10099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787599478.696948:0:10099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599478.696963:0:10099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696975:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696983:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696989:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.696996:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697002:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599478.697006:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697029:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697044:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599478.697047:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599478.697052:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697058:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697072:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697078:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697084:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697089:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599478.697092:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697098:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697110:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:1.0:1787599478.697113:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599478.697116:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697131:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d023b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697157:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d022d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe4c expref: 67 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697170:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe4c expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.697176:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.697178:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599478.697181:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599478.697364:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12472:x1874433559070336:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 758us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.697372:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:3.0:1787599478.700323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599478.700395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.700489:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070464 00000100:00100000:2.0:1787599478.700497:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070464 00000100:00100000:2.0:1787599478.700559:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1787599478.700569:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+66:2406:x1874433559070464:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599478.700584:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599478.700606:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe4c expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.700624:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:2.0:1787599478.700628:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599478.700678:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243663100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+65:2406:x1874433559070464:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 110us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.700685:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599478.701910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070720 00000100:00100000:1.0:1787599478.701918:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070720 00000100:00100000:1.0:1787599478.701957:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:1.0:1787599478.701967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ec34050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559070720:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599478.701983:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599478.702000:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0249 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe53 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.702112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.702126:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.702147:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.702178:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.702191:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 66 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599478.702205:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577995520:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599478.702285:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351453780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599478.707345:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577995520:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599478.707378:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599478.708150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599478.708230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559070848 00000100:00100000:2.0:1787599478.708237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559070848 00010000:00010000:2.0:1787599478.708273:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 67 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599478.708319:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1787599478.708328:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+67:2404:x1874433559070848:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599478.708341:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599478.708349:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 67 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708361:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 67 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708381:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4200/0x5d2988b0929d0218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe3e expref: 67 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708396:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:2.0:1787599478.708402:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708411:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708418:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599478.708444:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599478.708497:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+66:2404:x1874433559070848:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599478.708504:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00010000:00010000:1.0:1787599478.708559:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.708567:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599478.708584:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787599478.708706:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0249 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.708722:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.708741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.708744:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599478.708747:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031400, rc 0) 00000100:00100000:1.0:1787599478.708770:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ec34050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12472:x1874433559070720:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6806us (8375us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787599478.708777:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:3.0:1787599478.715088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.715168:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071104 00000100:00100000:1.0:1787599478.715178:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071104 00000100:00100000:1.0:1787599478.715242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599478.715251:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12472:x1874433559071104:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1787599478.715265:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599478.715286:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d01a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe22 expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.715304:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.715308:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599478.715359:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559071104:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.715366:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1787599478.719046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.719135:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071232 00000100:00100000:1.0:1787599478.719144:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071232 00000100:00100000:1.0:1787599478.719204:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:1.0:1787599478.719214:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559071232:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1787599478.719315:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.719347:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.719357:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599478.719448:0:13004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787599478.719523:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559071232:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 310us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.719532:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:3.0:1787599478.721866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599478.721945:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071360 00000100:00100000:1.0:1787599478.721953:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071360 00000100:00100000:1.0:1787599478.722003:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:1.0:1787599478.722013:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+65:12472:x1874433559071360:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599478.722039:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599478.722057:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe5a expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722103:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722113:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722131:0:10099:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722145:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722172:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599478.722175:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599478.722179:0:10099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 66 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599478.722198:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031a00, rc 0) 00000100:00100000:1.0:1787599478.722246:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12472:x1874433559071360:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 235us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599478.722253:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00000040:00080000:2.0:1787599479.013300:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599479.013320:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599479.013346:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787599479.013354:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599479.013474:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577995648:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599479.013739:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93000 going to sleep for 11 seconds 00010000:00010000:1.0:1787599479.014219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599479.030755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.030931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071488 00000100:00100000:1.0:1787599479.030943:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071488 00000100:00100000:1.0:1787599479.031035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1787599479.031046:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559071488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787599479.031078:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787599479.031176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559071488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 132us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.031183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:2.0:1787599479.031523:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577995648:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1787599479.031835:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599479.049434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.049555:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071616 00000100:00100000:2.0:1787599479.049565:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071616 00000100:00100000:2.0:1787599479.049646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:2.0:1787599479.049657:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12473:x1874433559071616:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.049727:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049754:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049767:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049783:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049814:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049822:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049847:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049872:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049879:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599479.049924:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787599479.049929:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599479.049944:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049955:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049962:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049969:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049974:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599479.049978:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049985:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.049997:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599479.050000:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599479.050005:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050035:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d026c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050049:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050055:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050061:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050066:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599479.050070:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050075:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050082:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff96b34dc78600) 00010000:00010000:2.0:1787599479.050084:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599479.050087:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050092:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0273 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050105:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050111:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050121:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050125:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599479.050128:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050134:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050141:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:2.0:1787599479.050144:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599479.050147:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.050153:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d027a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.050233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12473:x1874433559071616:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 576us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.050241:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:3.0:1787599479.076656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.076835:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559071872 00000100:00100000:2.0:1787599479.076845:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559071872 00000100:00100000:2.0:1787599479.076906:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:2.0:1787599479.076917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+66:12473:x1874433559071872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.076937:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599479.076956:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d0281 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe61 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077079:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077094:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077104:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599479.077114:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787599479.077196:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077204:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077211:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077216:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599479.077221:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077227:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077239:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:2.0:1787599479.077243:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599479.077247:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077262:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d0288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077302:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d0281 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe61 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077311:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:2.0:1787599479.077314:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599479.077318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d0281 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe61 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.077327:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599479.077390:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559071872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 474us (742us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1787599479.077397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:3.0:1787599479.086724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.086894:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559072000 00000100:00100000:0.0:1787599479.086902:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559072000 00000100:00100000:0.0:1787599479.086955:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:0.0:1787599479.086964:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559072000:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599479.087007:0:13004:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599479.087122:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559072000:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.087129:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:3.0:1787599479.093718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.093927:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559072256 00000100:00100000:1.0:1787599479.093937:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559072256 00000100:00100000:1.0:1787599479.094003:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:1.0:1787599479.094013:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559072256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.094066:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599479.094069:0:10099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787599479.094095:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d0226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe45 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094126:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599479.094131:0:10099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599479.094146:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d0296 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe68 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599479.094492:0:10099:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787599479.094635:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d029d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094648:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d029d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094658:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d029d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094701:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d0296 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe68 expref: 69 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094717:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d029d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe68 expref: 68 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.094725:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b370675900) 00010000:00010000:1.0:1787599479.094728:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599479.094730:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:1.0:1787599479.094848:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12473:x1874433559072256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 836us (1141us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787599479.094855:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:3.0:1787599479.099917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.100327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559072512 00000100:00100000:1.0:1787599479.100337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559072512 00000100:00100000:1.0:1787599479.102380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:1.0:1787599479.102396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12473:x1874433559072512:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.102452:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599479.102476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d029d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe68 expref: 68 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102495:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b370675900) 00010000:00010000:1.0:1787599479.102504:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599479.102522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102535:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102543:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102557:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102564:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102570:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102616:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102639:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102646:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102651:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340031000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599479.102656:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102663:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102671:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599479.102674:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599479.102677:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102683:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d02ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102692:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102698:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102704:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102708:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599479.102714:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102721:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102727:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x38a695fb (ffff96b370675d00) 00010000:00010000:1.0:1787599479.102729:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599479.102731:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.102737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d02b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x38a695fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.102897:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559072512:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 505us (2990us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599479.102904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:3.0:1787599479.112949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.113432:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559072640 00000100:00100000:2.0:1787599479.113443:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559072640 00000100:00100000:2.0:1787599479.113505:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:2.0:1787599479.113516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+67:12473:x1874433559072640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.113546:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599479.113571:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d02b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113616:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113629:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113652:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758400/0x5d2988b0929d02b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113787:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.113830:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599479.113834:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787599479.113837:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758800, rc 0) 00000100:00100000:2.0:1787599479.114267:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12473:x1874433559072640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 751us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.114275:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:3.0:1787599479.121134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.121211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559072896 00000100:00100000:2.0:1787599479.121222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559072896 00000100:00100000:2.0:1787599479.121275:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:2.0:1787599479.121284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+68:12473:x1874433559072896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.121361:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.121378:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.121388:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599479.121562:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787599479.121573:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425740779564ns, next at 426740776954ns, rc = 0 00000004:00010000:2.0:1787599479.121629:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ca475b5 reply state 00000000a39314cd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.121642:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.121649:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:2.0:1787599479.121652:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787599479.121655:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599479.121752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12473:x1874433559072896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 459us (620us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787599479.121759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:3.0:1787599479.124676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.124856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073024 00000100:00100000:0.0:1787599479.124865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073024 00000100:00100000:0.0:1787599479.124916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:0.0:1787599479.124926:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+70:12473:x1874433559073024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599479.124946:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599479.124964:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe76 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.125046:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.125059:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.125077:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599479.125080:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599479.125084:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4e00, rc 0) 00000100:00100000:0.0:1787599479.125134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12473:x1874433559073024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 209us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.125142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:3.0:1787599479.128524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.128621:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073152 00000100:00100000:0.0:1787599479.128629:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073152 00000100:00080000:3.0:1787599479.128730:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599479.129756:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1787599479.129770:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2405:x1874433559073152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787599479.129986:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2405:x1874433559073152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 220us (1467us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787599479.129995:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1787599479.134121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.134229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073408 00000100:00100000:1.0:1787599479.134239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073408 00000100:00100000:1.0:1787599479.134300:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1787599479.134312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+71:12473:x1874433559073408:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599479.134513:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+72:12473:x1874433559073408:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 202us (400us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1787599479.134520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599479.136720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.137003:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073664 00000100:00100000:1.0:1787599479.137012:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073664 00000100:00100000:1.0:1787599479.137075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:1.0:1787599479.137086:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+72:12473:x1874433559073664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599479.137199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+72:12473:x1874433559073664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 104us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.137207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:1.0:1787599479.139704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.140004:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073792 00000100:00100000:3.0:1787599479.140013:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073792 00000100:00100000:3.0:1787599479.140071:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:3.0:1787599479.140080:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+72:12473:x1874433559073792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599479.140099:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599479.140117:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d02d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe7d expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140248:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140263:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140289:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599479.140334:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599479.140351:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140376:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ca00/0x5d2988b0929d02d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe7d expref: 74 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140395:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe7d expref: 73 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.140404:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:3.0:1787599479.140407:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787599479.140411:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599479.140466:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+73:12473:x1874433559073792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 387us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599479.140474:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:3.0:1787599479.148070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.148228:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559073920 00000100:00100000:2.0:1787599479.148238:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559073920 00000100:00100000:2.0:1787599479.148298:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1787599479.148308:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+10:2403:x1874433559073920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.148329:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599479.148349:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe84 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599479.148373:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a77, blocks: 0x0 00010000:00010000:2.0:1787599479.148391:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1787599479.148395:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599479.148404:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.148443:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.148457:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599479.148517:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2403:x1874433559073920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 209us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.148524:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1787599479.150872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.151096:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074176 00000100:00100000:2.0:1787599479.151104:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074176 00000100:00100000:2.0:1787599479.151152:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:2.0:1787599479.151161:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+73:12473:x1874433559074176:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787599479.151265:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+73:12473:x1874433559074176:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 104us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.151273:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:1.0:1787599479.153944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.154063:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074304 00000100:00100000:2.0:1787599479.154071:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074304 00000100:00100000:2.0:1787599479.154159:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1787599479.154169:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:12473:x1874433559074304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.154193:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599479.154212:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe8b expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.154242:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.154269:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599479.154273:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599479.154279:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.154313:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.154327:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.154341:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874433577995776:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599479.154423:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599479.156589:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874433577995776:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599479.156630:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.156649:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758a00, rc 0) 00000100:00100000:2.0:1787599479.156722:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+12:12473:x1874433559074304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2553us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.156729:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1787599479.159641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.159867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074432 00000100:00100000:0.0:1787599479.159877:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074432 00010000:00010000:0.0:1787599479.159913:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.159950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1787599479.159970:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+12:2403:x1874433559074432:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599479.159986:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599479.160007:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.160032:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.160054:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d02e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe84 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.160070:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599479.160075:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599479.160082:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.160091:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.160124:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.160137:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874433577995904:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599479.160219:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599479.164222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.164318:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1874433577995904:192.168.202.1@tcp:105: 00010000:00010000:0.0:1787599479.164354:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599479.164409:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2403:x1874433559074432:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4438us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.164420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1787599479.164914:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074560 00000100:00100000:2.0:1787599479.164922:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074560 00002000:00100000:2.0:1787599479.164963:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff96b2433af100 x1874433559074560/t0(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:335/0 lens 504/0 e 0 to 0 dl 1787599490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599479.164980:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2433af100 with x1874433559074560 ext(0->12) 00002000:00010000:2.0:1787599479.164986:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2433af100 00000100:00100000:2.0:1787599479.165025:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599479.165035:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+11:2404:x1874433559074560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787599479.166066:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+13:2404:x1874433559074560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 1028us (1850us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787599479.166076:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:2.0:1787599479.166083:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff96b2433af100 x1874433559074560/t4294967321(0) o4->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:335/0 lens 504/448 e 0 to 0 dl 1787599490 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599479.166092:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2433af100 with x1874433559074560 ext(0->12) 00002000:00010000:2.0:1787599479.166096:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2433af100 00000100:00100000:1.0:1787599479.190908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.191191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074688 00000100:00100000:3.0:1787599479.191202:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074688 00000100:00100000:3.0:1787599479.191265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:3.0:1787599479.191275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+73:12473:x1874433559074688:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787599479.196509:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1787599479.196527:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:0.0:1787599479.196633:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196645:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196653:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196659:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.196664:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196672:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196689:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96b35acbbf00) 00010000:00010000:0.0:1787599479.196692:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.196698:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196704:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929cffef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196733:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196739:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196900:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196906:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.196909:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196915:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196924:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96b242e62c00) 00010000:00010000:0.0:1787599479.196927:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.196931:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196937:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759200/0x5d2988b0929d0097 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196966:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196973:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196978:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.196982:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.196985:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197000:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197009:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:0.0:1787599479.197011:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.197014:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197030:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759800/0x5d2988b0929d0115 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197051:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197058:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197064:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197069:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.197073:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197078:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197087:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b34dc78200) 00010000:00010000:0.0:1787599479.197089:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.197092:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197103:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200da00/0x5d2988b0929d0138 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197123:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197128:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197134:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197139:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.197141:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197148:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197156:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599479.197158:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.197161:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197166:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5c00/0x5d2988b0929d020a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.197177:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599479.197294:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787599479.197314:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b2440660c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787599479.197318:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b377bed000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b244066e40 00000020:00080000:1.0:1787599479.197321:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b377bed400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b24437ac00 00000004:00080000:1.0:1787599479.197342:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787599479.197364:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b377af8180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787599479.197367:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b242395b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b35ac73480 00000020:00080000:1.0:1787599479.197370:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b242395600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b24437aa00 00000020:00080000:1.0:1787599479.197379:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787599479.197443:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599479.197459:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577996032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787599479.197527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787599479.197699:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787599479.197769:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787599479.197778:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599479.197787:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577996288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787599479.197922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+22:12473:x1874433559074688:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 6646us (7020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599479.197931:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 244 00010000:00010000:0.0:1787599479.199696:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.199716:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.199722:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.199727:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.199735:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.199841:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599479.199845:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787599479.199850:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.199856:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d02c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.200061:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577996160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787599479.200105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.200508:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577996032 00000100:00100000:2.0:1787599479.200516:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577996032 00000100:00100000:2.0:1787599479.200559:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577996160 00000100:00100000:2.0:1787599479.200562:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577996160 00000100:00100000:2.0:1787599479.200590:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599479.200599:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577996032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787599479.200637:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1787599479.200664:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c9a76, atime: 0x6a8c9a76, ctime: 0x6a8c9a76, blocks: 0x8 00010000:00010000:2.0:1787599479.200672:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.200687:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1787599479.200691:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599479.200705:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.200720:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.200729:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.200736:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.200914:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599479.201071:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433577996032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 471us (3542us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787599479.201078:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599479.201095:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599479.201101:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433577996160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787599479.201112:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787599479.201126:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201140:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201148:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787599479.201151:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599479.201161:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201190:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201204:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 12 pid: 8435 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.201215:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577996416:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599479.201269:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8540 going to sleep for 11 seconds 00010000:00010000:2.0:1787599479.201284:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599479.201289:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201296:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599479.201299:0:10397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201306:0:10397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201319:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201325:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c6808c8/0x5d2988b0929d02f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.201349:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599479.201352:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599479.201353:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787599479.201383:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2433adf80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787599479.201390:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577996032:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787599479.201574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599479.201617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599479.207973:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577996288 00000100:00100000:2.0:1787599479.207990:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577996288 00000100:00100000:2.0:1787599479.208060:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599479.208071:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577996288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787599479.211108:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787599479.211117:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787599479 00002000:00010000:2.0:1787599479.211119:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787599479.211121:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787599479 -> 1787599479 00002000:00010000:2.0:1787599479.211124:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787599479.211221:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1874433577996288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3147us (9642us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787599479.211231:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1787599479.212002:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2436fc700/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787599479.212011:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577996288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787599479.212161:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874433577996416:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599479.212183:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599479.213617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.215124:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074816 00000100:00100000:2.0:1787599479.215136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074816 00010000:00010000:2.0:1787599479.215178:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 13 pid: 8435 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.215228:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1787599479.215237:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+13:2404:x1874433559074816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599479.215250:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599479.215256:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 13 pid: 8435 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.215270:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 13 pid: 8435 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.215292:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d00a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbde3 expref: 13 pid: 8435 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.215305:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599479.215309:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599479.215314:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.215324:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.215363:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599479.215419:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+12:2404:x1874433559074816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 183us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.215427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00010000:00010000:3.0:1787599479.215695:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.215706:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.215716:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.215724:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.215755:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599479.215940:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1874433577996160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14838us (15833us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787599479.215947:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1787599479.216132:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599479.216140:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.216149:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599479.216153:0:10398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.216163:0:10398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.216189:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.216197:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d02f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.216212:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599479.216214:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599479.216216:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787599479.217755:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2436fea00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787599479.217765:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433577996160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787599479.220404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.220480:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559074944 00000100:00100000:0.0:1787599479.220488:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559074944 00000100:00100000:0.0:1787599479.220548:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1787599479.220560:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+12:2404:x1874433559074944:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787599479.224625:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787599479.224643:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787599479.224854:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559074944:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 4290us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.224866:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1787599479.229988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.230215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075200 00000100:00100000:1.0:1787599479.230238:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075200 00000100:00100000:1.0:1787599479.230293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:1.0:1787599479.230302:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12473:x1874433559075200:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.230351:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599479.230374:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200cc00/0x5d2988b0929d02dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe7d expref: 21 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.230391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:1.0:1787599479.230396:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599479.230424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.230436:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.230446:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599479.230566:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f9fbf29 reply state 000000007fa6adc7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.230578:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.230584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:1.0:1787599479.230587:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599479.230589:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599479.231106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:12473:x1874433559075200:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 801us (1134us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787599479.231114:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:3.0:1787599479.235236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.235442:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075328 00000100:00100000:2.0:1787599479.235452:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075328 00000100:00100000:2.0:1787599479.235505:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1787599479.235515:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559075328:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787599479.235668:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787599479.235672:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787599479 -> 1787599478 00002000:00010000:2.0:1787599479.235675:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787599478 00002000:00010000:2.0:1787599479.235677:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787599479 -> 1787599478 00002000:00010000:2.0:1787599479.235680:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787599479.235738:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559075328:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 224us (511us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787599479.235754:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1787599479.238390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.238500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075584 00000100:00100000:1.0:1787599479.238509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075584 00000100:00100000:1.0:1787599479.238569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:1.0:1787599479.238579:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:12473:x1874433559075584:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.238649:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.238666:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.238676:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.238708:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.238722:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 22 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.238734:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577996544:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599479.238836:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351453cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599479.240827:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874433577996544:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599479.240860:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599479.243132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.243221:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075712 00000100:00100000:0.0:1787599479.243229:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075712 00010000:00010000:0.0:1787599479.243265:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 23 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.243305:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1787599479.243314:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:2403:x1874433559075712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599479.243328:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599479.243348:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 23 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243361:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 23 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243379:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758800/0x5d2988b0929d02c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe6f expref: 23 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243394:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599479.243399:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243406:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243413:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.243441:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599479.243487:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2403:x1874433559075712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.243494:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00010000:00010000:1.0:1787599479.244138:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244148:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244202:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244209:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244215:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244221:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152b400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599479.244225:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244232:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244242:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:1.0:1787599479.244244:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787599479.244247:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.244253:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0306 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.244297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12473:x1874433559075584:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 5719us (5915us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787599479.244305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:0.0:1787599479.250855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.254667:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075840 00000100:00100000:2.0:1787599479.254682:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075840 00000100:00100000:2.0:1787599479.254964:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1787599479.254986:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2404:x1874433559075840:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787599479.255039:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.255061:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.255070:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599479.255074:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599479.255095:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.255130:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.255145:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.255159:0:8629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577996672:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599479.255262:0:8629:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599479.258571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.258694:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559075968 00000100:00100000:1.0:1787599479.258702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559075968 00010000:00010000:1.0:1787599479.258739:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 9 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.258824:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1787599479.258833:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559075968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599479.258847:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599479.258867:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 9 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.258879:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 9 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.258900:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599479.258904:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599479.258909:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.258919:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.258936:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599479.258996:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+9:2404:x1874433559075968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.259002:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00010000:00010000:2.0:1787599479.262252:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d02ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe8b expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.262275:0:8629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1874433577996672:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599479.262301:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262312:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262319:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262344:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262374:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262383:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262390:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599479.262395:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262403:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262420:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.262429:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d030d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.262521:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2404:x1874433559075840:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 7536us (11675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599479.272708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.272983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559076224 00000100:00100000:0.0:1787599479.272993:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559076224 00000100:00100000:0.0:1787599479.273066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:0.0:1787599479.273077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+21:12473:x1874433559076224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787599479.273155:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.273195:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.273206:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.273244:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.273258:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 21 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.273273:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577996800:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599479.273363:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599479.277029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.277212:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559076352 00000100:00100000:1.0:1787599479.277221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559076352 00010000:00010000:1.0:1787599479.277260:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 22 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.277319:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1787599479.277329:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2403:x1874433559076352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599479.277343:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599479.277349:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 22 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277362:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 22 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277380:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599479.277386:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 22 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277395:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277403:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277410:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.277428:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599479.277479:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2403:x1874433559076352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 152us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.277486:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00010000:00010000:0.0:1787599479.277926:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4000/0x5d2988b0929d0203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe37 expref: 21 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.277942:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577996800:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599479.277960:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.277969:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.277974:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.278169:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.278186:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.278193:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.278218:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.278229:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 21 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.278241:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577996928:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599479.278302:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599479.278825:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1787599479.283357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.283454:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577996928:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599479.283478:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.286478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559076480 00000100:00100000:1.0:1787599479.286502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559076480 00010000:00010000:1.0:1787599479.286552:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 22 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.286602:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1787599479.286620:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2404:x1874433559076480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599479.286635:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599479.286641:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 22 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286654:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 22 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286673:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4e00/0x5d2988b0929d02ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe76 expref: 22 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286690:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:1.0:1787599479.286695:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286704:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286711:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.286729:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599479.287431:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+21:2404:x1874433559076480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 810us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.287449:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00010000:00010000:0.0:1787599479.287560:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.287578:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599479.287681:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787599479.288039:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1787599479.288076:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1787599479.288164:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874433577997056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787599479.288285:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599479.288315:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3534999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599479.288789:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577997056 00000100:00100000:1.0:1787599479.288817:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577997056 00000100:00100000:1.0:1787599479.288850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787599479.288859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3820ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874433577997056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787599479.288937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3820ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874433577997056:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.288944:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787599479.289971:0:6522:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1787599479.289978:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1787599479.290003:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2436fc700, transno 4294967322 00000004:00080000:0.0:1787599479.290030:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2436fea00, transno 4294967323 00000100:00100000:0.0:1787599479.290038:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874433577997056:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787599479.290156:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1787599479.290219:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874433577997184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787599479.290254:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599479.290281:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599479.290786:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577997184 00000100:00100000:1.0:1787599479.290815:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577997184 00000100:00100000:1.0:1787599479.290846:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787599479.290854:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1874433577997184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787599479.290961:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1874433577997184:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (706us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787599479.290968:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787599479.291206:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874433577997184:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787599479.291239:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291248:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291255:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291261:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.291265:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291272:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291286:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599479.291298:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599479.291303:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291309:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5800/0x5d2988b0929d031b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291331:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291337:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291342:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291347:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.291350:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291355:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291363:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599479.291365:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599479.291371:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291382:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.291420:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 24 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599479.291431:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577997312:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599479.291495:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599479.299518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.299616:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559076608 00000100:00100000:2.0:1787599479.299625:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559076608 00000100:00100000:2.0:1787599479.299681:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1787599479.299704:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12472:x1874433559076608:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:2.0:1787599479.299853:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+25:12472:x1874433559076608:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 150us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.299861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1787599479.300384:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874433577997312:192.168.202.1@tcp:105: 00010000:00010000:3.0:1787599479.300410:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300421:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d025e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300452:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300463:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300473:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300484:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300490:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300496:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300512:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599479.300516:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300522:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:3.0:1787599479.300886:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599479.300890:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300896:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d400/0x5d2988b0929d0322 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300906:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300912:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300918:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300924:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599479.300927:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300933:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300953:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:3.0:1787599479.300956:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599479.300959:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.300965:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5a00/0x5d2988b0929d0314 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599479.301568:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12473:x1874433559076224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 28491us (28867us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787599479.301584:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 247 00000020:00080000:3.0:1787599479.301589:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787599479.307596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.307708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559076864 00000100:00100000:0.0:1787599479.307718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559076864 00000100:00100000:0.0:1787599479.307781:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:0.0:1787599479.307815:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12472:x1874433559076864:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:0.0:1787599479.307982:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787599479.308068:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12472:x1874433559076864:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 277us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.308076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:0.0:1787599479.310045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599479.314954:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559077120 00000100:00100000:2.0:1787599479.314969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559077120 00000100:00100000:2.0:1787599479.315055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1787599479.315067:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+24:12473:x1874433559077120:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787599479.315320:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787599479.315352:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787599479.315381:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315396:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315407:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315414:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315420:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315427:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599479.315451:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599479.315534:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+26:12473:x1874433559077120:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 469us (5495us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787599479.315554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000020:00080000:2.0:1787599479.315559:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787599479.316095:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599479.316102:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.316109:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599479.316112:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.316119:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.316131:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:0.0:1787599479.316134:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787599479.316146:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.316151:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758a00/0x5d2988b0929d0329 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.316163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599479.316164:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599479.316166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599479.318846:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599479.318856:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599479.318897:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787599479.318907:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599479.319032:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577997440:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599479.319114:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351453780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599479.336332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.336927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559077248 00000100:00100000:3.0:1787599479.336938:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559077248 00000100:00100000:3.0:1787599479.336997:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:3.0:1787599479.337008:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12475:x1874433559077248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599479.337051:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599479.337158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12475:x1874433559077248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 151us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599479.337166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:1.0:1787599479.338400:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1874433577997440:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599479.363031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599479.363066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.363151:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559077504 00000100:00100000:1.0:1787599479.363162:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559077504 00000100:00100000:1.0:1787599479.363223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559077632 00000100:00100000:1.0:1787599479.363239:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559077632 00000100:00100000:1.0:1787599479.363274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:1.0:1787599479.363284:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+27:12475:x1874433559077504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.363307:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599479.363328:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0330 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe92 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363430:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363444:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363454:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599479.363465:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787599479.363567:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a200/0x5d2988b0929d0330 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe92 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363586:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe92 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599479.363597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787599479.363601:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599479.363652:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+29:12475:x1874433559077504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 370us (641us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787599479.363660:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:1.0:1787599479.363687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:1.0:1787599479.363694:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+28:12477:x1874433559077632:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599479.363703:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599479.363712:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0345 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbe99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363761:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363771:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.363778:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364031:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364040:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364048:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364105:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364115:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364123:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364158:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.364172:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 29 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.364304:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577997568:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599479.364360:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351453e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599479.368091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.368439:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559077888 00000100:00100000:3.0:1787599479.368448:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559077888 00000100:00100000:3.0:1787599479.368498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1787599479.368508:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+30:6645:x1874433559077888:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787599479.368724:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+31:6645:x1874433559077888:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 216us (639us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787599479.368753:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1787599479.369864:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874433577997568:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599479.369890:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599479.370668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599479.370848:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559078144 00000100:00100000:1.0:1787599479.370853:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559078144 00000100:00100000:1.0:1787599479.370883:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:1.0:1787599479.370891:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+31:12475:x1874433559078144:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787599479.370949:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.370964:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.370975:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371113:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371133:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371139:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371146:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599479.371150:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371158:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371170:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599479.371173:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599479.371189:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599479.371196:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d0361 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599479.371308:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+32:12475:x1874433559078144:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 416us (641us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787599479.371316:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000040:00080000:2.0:1787599479.371857:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599479.371862:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599479.372366:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787599479.372374:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599479.377360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.377449:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559078400 00000100:00100000:3.0:1787599479.377460:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559078400 00000100:00100000:3.0:1787599479.377518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1787599479.377528:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+32:12475:x1874433559078400:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599479.377825:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+33:12475:x1874433559078400:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 264us (440us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787599479.377834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1787599479.382633:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599479.382754:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559078528 00000100:00100000:3.0:1787599479.382763:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559078528 00010000:00010000:3.0:1787599479.382837:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 33 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599479.382869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1787599479.382878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+33:2403:x1874433559078528:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599479.382892:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599479.382897:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 33 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.382910:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 33 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.382929:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0250 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe53 expref: 33 pid: 6521 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.382945:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:3.0:1787599479.382961:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.382970:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.382978:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599479.383001:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599479.383386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+32:2403:x1874433559078528:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 508us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599479.383395:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00010000:00010000:0.0:1787599479.383826:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383835:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599479.383881:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787599479.383885:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599479.383903:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383915:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383924:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383930:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383947:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383952:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152ac00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.383955:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383963:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383972:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:0.0:1787599479.383975:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.383979:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383985:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ac00/0x5d2988b0929d034c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.383996:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384003:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384117:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599479.384121:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384136:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384145:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96b37789fa00) 00010000:00010000:0.0:1787599479.384147:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599479.384151:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d0353 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384206:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152b400/0x5d2988b0929d0345 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe99 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384222:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe99 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599479.384229:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:0.0:1787599479.384232:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599479.384234:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340031000, rc 0) 00000100:00100000:0.0:1787599479.384313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+31:12477:x1874433559077632:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 20618us (21245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599479.384320:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:2.0:1787599479.846961:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577997696:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847086:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577998208:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847134:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577998720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847187:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577999232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787599479.847244:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577998080:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847287:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577998592:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847324:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577999104:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847373:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577997824:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847428:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577998336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847465:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577998848:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847502:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599479.847507:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577997952:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.847544:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577998464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.847565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.848107:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577998976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.848130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.848159:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577997696 00000100:00100000:2.0:1787599479.848165:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577997696 00000100:00100000:1.0:1787599479.848359:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998720 00000100:00100000:1.0:1787599479.848363:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998720 00000100:00100000:1.0:1787599479.848399:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999232 00000100:00100000:1.0:1787599479.848402:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999232 00000100:00100000:1.0:1787599479.848411:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998592 00000100:00100000:1.0:1787599479.848413:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998592 00000100:00100000:1.0:1787599479.848445:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999104 00000100:00100000:1.0:1787599479.848449:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999104 00000100:00100000:1.0:1787599479.848465:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599479.848474:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577998720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.848528:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433577998720:12345-0@lo:400:kworker.0 Request processed in 55us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.848534:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599479.848551:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787599479.848557:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577999232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.848598:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577999232:12345-0@lo:400:kworker.0 Request processed in 41us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.848604:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787599479.848773:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787599479.848780:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577998592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.848828:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577998592:12345-0@lo:400:kworker.0 Request processed in 49us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.848834:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787599479.848846:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787599479.848852:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577999104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.848877:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577999104:12345-0@lo:400:kworker.0 Request processed in 26us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.848883:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787599479.848904:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998080 00000100:00100000:1.0:1787599479.848908:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998080 00000100:00100000:1.0:1787599479.848926:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577997824 00000100:00100000:1.0:1787599479.848928:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577997824 00000100:00100000:1.0:1787599479.848937:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998336 00000100:00100000:1.0:1787599479.848944:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998336 00000100:00100000:1.0:1787599479.848959:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998848 00000100:00100000:1.0:1787599479.848962:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998848 00000100:00100000:1.0:1787599479.848971:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998464 00000100:00100000:1.0:1787599479.848973:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998464 00000100:00100000:1.0:1787599479.848983:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998976 00000100:00100000:1.0:1787599479.848985:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998976 00000100:00100000:1.0:1787599479.848997:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787599479.849002:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577998080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849045:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433577998080:12345-0@lo:400:kworker.0 Request processed in 43us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849051:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787599479.849061:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787599479.849066:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577997824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849087:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433577997824:12345-0@lo:400:kworker.0 Request processed in 21us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849093:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787599479.849103:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787599479.849109:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849133:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433577998336:12345-0@lo:400:kworker.0 Request processed in 25us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849139:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787599479.849150:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787599479.849155:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577998848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849192:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433577998848:12345-0@lo:400:kworker.0 Request processed in 36us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849197:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787599479.849216:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787599479.849221:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577998464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849247:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433577998464:12345-0@lo:400:kworker.0 Request processed in 26us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849252:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787599479.849263:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787599479.849268:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577998976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849291:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433577998976:12345-0@lo:400:kworker.0 Request processed in 23us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849296:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787599479.849320:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577998208 00000100:00100000:1.0:1787599479.849323:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577998208 00000100:00100000:1.0:1787599479.849344:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577997952 00000100:00100000:1.0:1787599479.849347:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577997952 00000100:00100000:1.0:1787599479.849360:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599479.849365:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577998208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849395:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433577998208:12345-0@lo:400:kworker.0 Request processed in 30us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849400:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599479.849411:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787599479.849416:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849441:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577997952:12345-0@lo:400:kworker.0 Request processed in 25us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787599479.849501:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599479.849527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599479.849569:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577997952:0@lo:400:kworker.0 00010000:00080000:1.0:1787599479.849583:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e4000 x1874433577998464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599479.849592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433577998464:0@lo:400:kworker.0 00010000:00080000:1.0:1787599479.849602:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e7480 x1874433577998976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599479.849610:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433577998976:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849619:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433577997824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849628:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433577998336:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433577998848:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849668:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999360 00000100:00100000:1.0:1787599479.849672:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999360 00000100:00100000:1.0:1787599479.849698:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787599479.849705:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577999360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599479.849718:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1787599479.849750:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433577999360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599479.849756:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787599479.849783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433577999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599479.849846:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433577998080:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849858:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577998592:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849867:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577999104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849886:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577998208:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849896:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577998720:0@lo:400:kworker.0 00000100:00100000:1.0:1787599479.849906:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577999232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.850685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787599479.850693:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577997696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599479.850807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3648:x1874433577997696:12345-0@lo:400:kworker.0 Request processed in 44us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.850813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787599479.850853:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433577997696:0@lo:400:kworker.0 00000100:00080000:3.0:1787599479.850959:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599479.850964:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599479.850967:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599479.850969:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599479.851486:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599479.851496:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577999488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599479.851527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599479.851558:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999488 00000100:00100000:2.0:1787599479.851563:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999488 00000100:00100000:2.0:1787599479.852124:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787599479.852132:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577999488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599479.852146:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787599479.852245:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577999488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599479.852252:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787599479.852286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577999488:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787599480.039321:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599480.345717:0:14714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599480.345726:0:14714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599480.345755:0:14714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787599480.345761:0:14714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599480.356973:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599480.357003:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599480.357080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599480.357144:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999616 00000100:00100000:0.0:1787599480.357151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999616 00000100:00100000:0.0:1787599480.357217:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787599480.357227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577999616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599480.357253:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599480.357294:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433577999616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599480.357300:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1787599480.357319:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599480.357355:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433577999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599480.357505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577999744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599480.357543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599480.357659:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999744 00000100:00100000:1.0:1787599480.357664:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999744 00000100:00100000:1.0:1787599480.357694:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787599480.357701:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577999744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599480.357711:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599480.357740:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433577999744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599480.357746:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787599480.357829:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433577999744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599480.616082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599480.616188:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559078784 00000100:00100000:1.0:1787599480.616198:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559078784 00000100:00100000:1.0:1787599480.616289:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:1.0:1787599480.616300:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+31:12501:x1874433559078784:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599480.616323:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599480.616343:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0368 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbea0 expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.616441:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d036f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.616453:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d036f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.616466:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d036f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599480.616485:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787599480.616749:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031400/0x5d2988b0929d0368 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea0 expref: 34 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.616767:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d036f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea0 expref: 33 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.616775:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599480.616778:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787599480.616782:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030600, rc 0) 00000100:00100000:1.0:1787599480.616948:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4ef2ef44-63df-45fd-9e68-c54398cec083+33:12501:x1874433559078784:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 649us (873us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787599480.616955:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:2.0:1787599480.620221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599480.620290:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559078912 00000100:00100000:1.0:1787599480.620299:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559078912 00000100:00100000:1.0:1787599480.620355:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:1.0:1787599480.620365:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+33:12501:x1874433559078912:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1787599480.620426:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620441:0:10099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620452:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620485:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620497:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620504:0:10099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620510:0:10099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030c00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599480.620514:0:10099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620521:0:10099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620545:0:10099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599480.620549:0:10099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599480.620553:0:10099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.620559:0:10099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030c00/0x5d2988b0929d037d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599480.620629:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+33:12501:x1874433559078912:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 265us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599480.620636:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:2.0:1787599480.725416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599480.725553:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079040 00000100:00100000:1.0:1787599480.725564:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079040 00000100:00100000:1.0:1787599480.725672:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1787599480.725683:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559079040:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1787599480.725703:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599480.725736:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d9af73/0x5d2988b0929d0384 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbea7 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599480.725762:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c9a76, atime: 0x6a8c9a76, ctime: 0x6a8c9a76, blocks: 0x8 00010000:00010000:1.0:1787599480.725782:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787599480.725787:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599480.726071:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d9af73/0x5d2988b0929d0384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea7 expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.726093:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095d9af73/0x5d2988b0929d0384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea7 expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599480.726107:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b340030c00, rc 0) 00000100:00100000:1.0:1787599480.726164:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2403:x1874433559079040:12345-192.168.202.1@tcp:101:cat.0 Request processed in 482us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599480.726182:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1787599480.729623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599480.729750:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079168 00000100:00100000:2.0:1787599480.729760:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079168 00002000:00100000:2.0:1787599480.729851:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff96b2436fd180 x1874433559079168/t0(0) o3->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:336/0 lens 488/0 e 0 to 0 dl 1787599491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599480.729861:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2436fd180 with x1874433559079168 ext(0->4095) 00002000:00010000:2.0:1787599480.729867:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2436fd180 00000100:00100000:2.0:1787599480.729889:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599480.729899:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2405:x1874433559079168:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:2.0:1787599480.730058:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2405:x1874433559079168:12345-192.168.202.1@tcp:3:cat.0 Request processed in 159us (444us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787599480.730065:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00002000:00100000:2.0:1787599480.730073:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff96b2436fd180 x1874433559079168/t0(0) o3->4ef2ef44-63df-45fd-9e68-c54398cec083@192.168.202.1@tcp:336/0 lens 488/4536 e 0 to 0 dl 1787599491 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599480.730081:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96b2436fd180 with x1874433559079168 ext(0->4095) 00002000:00010000:2.0:1787599480.730084:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96b2436fd180 00010000:00010000:2.0:1787599481.065606:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599481.381546:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577999872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599481.381626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599481.381894:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433577999872 00000100:00100000:3.0:1787599481.381904:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433577999872 00000100:00100000:3.0:1787599481.381966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787599481.381976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577999872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599481.382021:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787599481.382077:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433577999872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599481.382085:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787599481.382121:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433577999872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599482.086387:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599482.471571:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599482.471591:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599482.471622:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787599482.471629:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599482.848355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.848401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.848434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.848460:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079424 00000100:00100000:2.0:1787599482.848469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079424 00000100:00100000:3.0:1787599482.848512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079552 00000100:00100000:3.0:1787599482.848516:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079552 00000100:00100000:2.0:1787599482.848526:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:2.0:1787599482.848536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+33:2405:x1874433559079424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599482.848540:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 336 00000100:00100000:3.0:1787599482.848553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559079552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599482.848645:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079296 00000100:00100000:1.0:1787599482.848649:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079296 00000100:00100000:1.0:1787599482.848683:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 391 00000100:00100000:1.0:1787599482.848689:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559079296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599482.848734:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559079552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 182us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599482.848741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 336 00000100:00100000:2.0:1787599482.856075:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+33:2405:x1874433559079424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 7529us (7661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599482.856075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2406:x1874433559079296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 7381us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599482.856092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:1.0:1787599482.856092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 391 00000100:00080000:2.0:1787599482.856143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599482.856149:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599482.856215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.856302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.856335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.856359:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079936 00000100:00100000:2.0:1787599482.856368:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079936 00000100:00100000:2.0:1787599482.856421:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:2.0:1787599482.856430:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559079936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599482.856488:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2405:x1874433559079936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599482.856494:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00080000:2.0:1787599482.856508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599482.856548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599482.858434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080064 00000100:00100000:2.0:1787599482.858446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080064 00000100:00100000:2.0:1787599482.858506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 338 00000100:00100000:2.0:1787599482.858516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559080064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599482.859770:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559080064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1250us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599482.859782:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 338 00000100:00080000:2.0:1787599482.860109:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599482.860173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079680 00000100:00100000:1.0:1787599482.860181:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079680 00000100:00100000:1.0:1787599482.860235:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559079808 00000100:00100000:1.0:1787599482.860238:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559079808 00000100:00100000:1.0:1787599482.860280:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1787599482.860290:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2405:x1874433559079680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599482.860348:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+8:2405:x1874433559079680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599482.860355:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1787599482.860368:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1787599482.860375:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559079808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599482.860397:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559079808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (4095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599482.860403:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00080000:0.0:1787599482.865295:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599482.865306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599482.917224:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599482.917250:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578000000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599482.917320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599482.917581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000000 00000100:00100000:0.0:1787599482.917590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000000 00000100:00100000:0.0:1787599482.917644:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787599482.917655:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578000000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599482.917701:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599482.917759:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578000000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599482.917767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787599482.917995:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578000000:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787599482.981592:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599483.109018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599484.136219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787599484.456830:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1787599484.967188:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599484.967213:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578000128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599484.967281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599484.969208:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000128 00000100:00100000:1.0:1787599484.969222:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000128 00000100:00100000:1.0:1787599484.969308:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599484.969321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578000128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599484.969354:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787599484.969430:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578000128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599484.969437:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599484.969497:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578000128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599484.969725:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578000640:0@lo:400:kworker.0 00000100:00100000:2.0:1787599484.969725:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578000384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.969760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599484.969762:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578000512:0@lo:400:kworker.0 00000100:00100000:2.0:1787599484.969787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.969811:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578001152:0@lo:400:kworker.0 00000100:00100000:1.0:1787599484.969881:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000640 00000100:00100000:1.0:1787599484.969884:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000640 00000100:00100000:1.0:1787599484.969913:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787599484.969919:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578000640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599484.969952:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578001024:0@lo:400:kworker.0 00000100:00080000:0.0:1787599484.970022:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599484.970049:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000512 00000100:00100000:0.0:1787599484.970052:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000512 00000100:00100000:0.0:1787599484.970078:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787599484.970084:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.971321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971659:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578001664:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.971689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787599484.971721:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578000256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.971748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971770:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578000768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.971806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971824:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578001280:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.971846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971863:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578001792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599484.971883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.971916:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001152 00000100:00100000:3.0:1787599484.971921:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001152 00000100:00100000:3.0:1787599484.971961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001664 00000100:00100000:3.0:1787599484.971975:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001664 00000100:00100000:3.0:1787599484.973103:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787599484.973138:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578001152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973205:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578001152:12345-0@lo:400:kworker.0 Request processed in 80us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973212:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787599484.973226:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787599484.973232:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578001664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973255:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578001664:12345-0@lo:400:kworker.0 Request processed in 24us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973260:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787599484.973283:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000256 00000100:00100000:3.0:1787599484.973287:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000256 00000100:00100000:3.0:1787599484.973318:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787599484.973324:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433578000256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433578000256:12345-0@lo:400:kworker.0 Request processed in 41us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787599484.973404:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000768 00000100:00100000:3.0:1787599484.973408:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000768 00000100:00100000:3.0:1787599484.973423:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787599484.973428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578000768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973455:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578000768:12345-0@lo:400:kworker.0 Request processed in 27us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973461:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787599484.973477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001280 00000100:00100000:3.0:1787599484.973479:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001280 00000100:00100000:3.0:1787599484.973516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787599484.973522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578001280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578001280:12345-0@lo:400:kworker.0 Request processed in 46us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787599484.973591:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001792 00000100:00100000:3.0:1787599484.973595:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001792 00000100:00100000:3.0:1787599484.973615:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787599484.973620:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578001792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599484.973634:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787599484.973660:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578001792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.973665:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1787599484.973686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599484.973690:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599484.973692:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599484.973723:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578000256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973735:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578000768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578001280:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973758:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578001792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599484.973766:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578001152:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.973774:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787599484.973780:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1787599484.973823:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2433adf80, transno 4294967311 00000100:00100000:3.0:1787599484.973837:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578001664:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.974247:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578000896:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.974306:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578001408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.974355:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000384 00000100:00100000:3.0:1787599484.974359:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000384 00000100:00100000:3.0:1787599484.974379:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578000896 00000100:00100000:3.0:1787599484.974382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578000896 00000100:00100000:3.0:1787599484.974398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001408 00000100:00100000:3.0:1787599484.974401:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001408 00000100:00100000:3.0:1787599484.974414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787599484.974421:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578000384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974456:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578000384:12345-0@lo:400:kworker.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.974462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787599484.974473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787599484.974479:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578000896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974506:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578000896:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.974511:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787599484.974521:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787599484.974527:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578001408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974552:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578001408:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599484.974557:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:3.0:1787599484.974572:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599484.974574:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599484.974598:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578000384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.974609:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578000896:0@lo:400:kworker.0 00010000:00080000:3.0:1787599484.974620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa06680 x1874433578001408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599484.974630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578001408:0@lo:400:kworker.0 00000001:00080000:3.0:1787599484.976948:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1787599484.977104:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b3534999c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787599484.977111:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b242395a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b353499480 00000020:00080000:3.0:1787599484.977115:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b242395000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b2440c5e00 00000020:00080000:3.0:1787599484.977187:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787599484.977200:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787599484.977268:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787599484.977300:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977311:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977319:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977325:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599484.977330:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977845:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977881:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96b34dc78600) 00010000:00010000:3.0:1787599484.977884:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599484.977889:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599484.977896:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152be00/0x5d2988b0929d02ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599484.979573:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578000640:12345-0@lo:400:kworker.0 Request processed in 9645us (9803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599484.979595:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787599484.979608:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578000640:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.991167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599484.991231:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578001536:0@lo:400:kworker.0 00000100:00100000:3.0:1787599484.991277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599484.991370:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001536 00000100:00100000:1.0:1787599484.991379:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001536 00000100:00100000:1.0:1787599484.991446:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787599484.991455:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578001536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599484.991512:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578001536:12345-0@lo:400:kworker.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599484.991519:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787599484.991562:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578001536:0@lo:400:kworker.0 00000100:00080000:3.0:1787599484.991624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599484.991719:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578000512:12345-0@lo:400:kworker.0 Request processed in 21632us (21928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599484.991728:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787599484.991790:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578000512:0@lo:400:kworker.0 00000100:00100000:2.0:1787599484.992228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001024 00000100:00100000:2.0:1787599484.992233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001024 00000100:00100000:2.0:1787599484.992285:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787599484.992293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578001024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599484.992341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578001024:12345-0@lo:400:kworker.0 Request processed in 49us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599484.992348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00080000:1.0:1787599484.992415:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa06a00 x1874433578001024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599484.992427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578001024:0@lo:400:kworker.0 00000100:00080000:3.0:1787599484.992502:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787599485.160045:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599485.488086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578001920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599485.488103:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578002048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599485.491685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599485.493049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787599485.495541:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1787599485.495556:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:1.0:1787599485.510333:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578001920 00000100:00100000:0.0:1787599485.510333:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002048 00000100:00100000:1.0:1787599485.510351:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578001920 00000100:00100000:0.0:1787599485.510351:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002048 00000100:00100000:0.0:1787599485.511255:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787599485.511268:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578002048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599485.511304:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599485.511385:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578002048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (18341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599485.511392:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787599485.512725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578002048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599485.513024:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787599485.513038:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578001920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599485.513059:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787599485.513126:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578001920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (21452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599485.513134:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787599485.513277:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578001920:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787599486.180978:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599486.501837:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578002176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599486.501910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599486.502108:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002176 00000100:00100000:1.0:1787599486.502117:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002176 00000100:00100000:1.0:1787599486.502166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787599486.502175:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578002176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599486.502213:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787599486.502260:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578002176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599486.502267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787599486.502397:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578002176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599486.680016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599486.681032:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080192 00000100:00100000:0.0:1787599486.681043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080192 00000100:00100000:0.0:1787599486.681128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1787599486.681141:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12152:x1874433559080192:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787599486.681251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12152:x1874433559080192:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 113us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599486.681260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00080000:3.0:1787599486.681432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599486.684606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599486.684762:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080320 00000100:00100000:2.0:1787599486.684771:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080320 00000100:00100000:2.0:1787599486.684864:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:2.0:1787599486.684875:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:12152:x1874433559080320:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787599486.685003:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:12152:x1874433559080320:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 129us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599486.685011:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00080000:3.0:1787599486.685431:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599486.689717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599486.689842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080576 00000100:00100000:3.0:1787599486.689854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080576 00000100:00100000:3.0:1787599486.689909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1787599486.689919:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+19:12152:x1874433559080576:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599486.690177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:12152:x1874433559080576:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 259us (469us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787599486.690201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1787599487.066598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599487.066741:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080704 00000100:00100000:0.0:1787599487.066751:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080704 00000100:00100000:0.0:1787599487.066864:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:0.0:1787599487.066876:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:12959:x1874433559080704:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:0.0:1787599487.066899:0:13004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599487.066922:0:13004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d038b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbeae expref: -99 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067006:0:13004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067021:0:13004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067036:0:13004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599487.067087:0:13004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599487.067091:0:13004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599487.067123:0:13004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067163:0:13004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5400/0x5d2988b0929d038b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeae expref: 7 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067186:0:13004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeae expref: 6 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599487.067195:0:13004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:0.0:1787599487.067198:0:13004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599487.067202:0:13004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5200, rc 0) 00000100:00100000:0.0:1787599487.067270:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:12959:x1874433559080704:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 396us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599487.067277:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00080000:3.0:1787599487.068589:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599487.205278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599487.951688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599487.951736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599487.951777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599487.951838:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081216 00000100:00100000:1.0:1787599487.951849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599487.951850:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081216 00000100:00100000:1.0:1787599487.951877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599487.951905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599487.951927:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081344 00000100:00100000:2.0:1787599487.951933:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081344 00000100:00100000:1.0:1787599487.951933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599487.951970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080832 00000100:00100000:1.0:1787599487.951975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080832 00000100:00100000:2.0:1787599487.951980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1787599487.951993:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559081216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599487.952011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 393 00000100:00100000:1.0:1787599487.952022:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433559080832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599487.952085:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2403:x1874433559080832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599487.952093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 393 00000100:00100000:3.0:1787599487.952116:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1787599487.952128:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433559081344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599487.952137:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559080960 00000100:00100000:1.0:1787599487.952143:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559080960 00000100:00100000:0.0:1787599487.952204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081472 00000100:00100000:0.0:1787599487.952208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081472 00000100:00100000:1.0:1787599487.952301:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081088 00000100:00100000:1.0:1787599487.952305:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081088 00000100:00100000:2.0:1787599487.960048:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2403:x1874433559081216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 8046us (8298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599487.960063:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1787599487.960126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081600 00000100:00100000:2.0:1787599487.960134:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081600 00000100:00100000:0.0:1787599487.960232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 345 00000100:00100000:0.0:1787599487.960246:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+20:2403:x1874433559080960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599487.960324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+20:2403:x1874433559080960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (8648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599487.960331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 345 00000100:00100000:0.0:1787599487.960346:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 346 00000100:00100000:0.0:1787599487.960352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2403:x1874433559081472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599487.960376:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2403:x1874433559081472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (8599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599487.960381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 346 00000100:00080000:0.0:1787599487.960569:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599487.960574:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599487.960577:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599487.964513:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433559081344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 12375us (12594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599487.964528:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1787599487.966530:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 347 00000100:00100000:1.0:1787599487.966552:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433559081088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599487.966638:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2403:x1874433559081088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 95us (14761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599487.966646:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 347 00000100:00100000:2.0:1787599487.969121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 348 00000100:00100000:2.0:1787599487.969141:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433559081600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599487.969241:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2403:x1874433559081600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 108us (17309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599487.969250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 348 00000100:00100000:2.0:1787599488.038855:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599488.038879:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578002304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599488.038965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599488.039070:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002304 00000100:00100000:0.0:1787599488.039077:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002304 00000100:00100000:0.0:1787599488.039113:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787599488.039120:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578002304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599488.039148:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787599488.039204:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578002304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599488.039211:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787599488.039352:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578002304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787599488.230032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599489.253470:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599490.085448:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578002432:0@lo:400:kworker.0 00000100:00100000:3.0:1787599490.085515:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578002816:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.085524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599490.085548:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.085573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578002944:0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.085807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002816 00000100:00100000:0.0:1787599490.085814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002816 00000100:00100000:0.0:1787599490.085863:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787599490.085873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578002816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.085942:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578002816:12345-0@lo:400:kworker.0 Request processed in 71us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.085949:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787599490.085987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002432 00000100:00100000:0.0:1787599490.085991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002432 00000100:00100000:0.0:1787599490.086014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787599490.086021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433578002432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.086050:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433578002432:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.086057:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787599490.086084:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578002688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.086110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599490.086140:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578003200:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086481:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578003456:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086519:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578003968:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086571:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578002432:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086597:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787599490.086605:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578002560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086628:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086645:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578003072:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086684:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578003584:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599490.086732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002688 00000100:00100000:2.0:1787599490.086736:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002688 00000100:00100000:2.0:1787599490.086772:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002944 00000100:00100000:2.0:1787599490.086776:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002944 00000100:00100000:2.0:1787599490.086790:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787599490.086812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578002688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.086848:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578002688:12345-0@lo:400:kworker.0 Request processed in 37us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599490.086855:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787599490.086869:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787599490.086874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578002944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087014:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578002944:12345-0@lo:400:kworker.0 Request processed in 139us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599490.087021:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787599490.087042:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578002560 00000100:00100000:2.0:1787599490.087046:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578002560 00000100:00100000:2.0:1787599490.087069:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003072 00000100:00100000:2.0:1787599490.087072:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003072 00000100:00100000:2.0:1787599490.087097:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003584 00000100:00100000:2.0:1787599490.087100:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003584 00000100:00100000:2.0:1787599490.087125:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787599490.087132:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578002560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087290:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578002560:12345-0@lo:400:kworker.0 Request processed in 158us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599490.087296:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787599490.087311:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787599490.087318:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578003072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087346:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578003072:12345-0@lo:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599490.087351:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787599490.087362:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787599490.087368:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578003584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087394:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578003584:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599490.087399:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787599490.087435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578002560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087445:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578003072:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087453:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578003584:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.087461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578002944:0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.087846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599490.087876:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578003712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.087897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599490.088002:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578002688:0@lo:400:kworker.0 00000100:00080000:0.0:1787599490.088021:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599490.088033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003200 00000100:00100000:0.0:1787599490.088036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003200 00000100:00100000:0.0:1787599490.088065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003712 00000100:00100000:0.0:1787599490.088067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003712 00000100:00100000:0.0:1787599490.088084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787599490.088091:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578003200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.088126:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578003200:12345-0@lo:400:kworker.0 Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.088132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787599490.088144:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787599490.089035:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003456 00000100:00100000:1.0:1787599490.089042:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003456 00000100:00100000:1.0:1787599490.089075:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003968 00000100:00100000:1.0:1787599490.089078:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003968 00000100:00100000:1.0:1787599490.089110:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599490.089134:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578003456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.089184:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578003456:12345-0@lo:400:kworker.0 Request processed in 56us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.089190:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599490.089204:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787599490.089211:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.089237:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578003968:12345-0@lo:400:kworker.0 Request processed in 28us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.089243:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787599490.090045:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787599490.090052:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1787599490.090072:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578003456:0@lo:400:kworker.0 00000100:00100000:2.0:1787599490.090086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578003968:0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.090101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578004096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599490.090145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599490.090183:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004096 00000100:00100000:1.0:1787599490.090188:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004096 00000100:00100000:1.0:1787599490.090217:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599490.090223:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578004096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599490.090248:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787599490.090286:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578004096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.090292:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599490.090343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578004096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787599490.090371:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599490.090375:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599490.090378:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599490.090393:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599490.090416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787599490.090466:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87ed80 x1874433578003200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599490.090475:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.090477:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578003200:0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.090502:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004224 00000100:00100000:1.0:1787599490.090506:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004224 00000100:00100000:0.0:1787599490.090516:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578003712:12345-0@lo:400:kworker.0 Request processed in 626us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.090522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787599490.090524:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787599490.090529:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578004224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599490.090539:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00010000:00080000:0.0:1787599490.090555:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37f87c700 x1874433578003712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599490.090563:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578004224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.090565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578003712:0@lo:400:kworker.0 00000100:00100000:1.0:1787599490.090569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787599490.090582:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599490.090842:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578002816:0@lo:400:kworker.0 00000100:00100000:3.0:1787599490.090851:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578003328:0@lo:400:kworker.0 00000100:00100000:3.0:1787599490.090878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599490.090903:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578003840:0@lo:400:kworker.0 00000100:00100000:3.0:1787599490.090933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599490.091158:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003328 00000100:00100000:1.0:1787599490.091163:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003328 00000100:00100000:1.0:1787599490.091188:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578003840 00000100:00100000:1.0:1787599490.091190:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578003840 00000100:00100000:1.0:1787599490.091215:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787599490.091222:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578003328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599490.091253:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787599490.091267:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578003840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787599490.091333:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599490.092183:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578003328:12345-0@lo:400:kworker.0 Request processed in 957us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.092193:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000001:00080000:2.0:1787599490.094856:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787599490.094872:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787599490.095208:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787599490.095221:0:6552:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787599490.099217:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578003840:12345-0@lo:400:kworker.0 Request processed in 7941us (8272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599490.099232:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599490.099900:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578003328:0@lo:400:kworker.0 00000100:00100000:3.0:1787599490.099935:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578003840:0@lo:400:kworker.0 00010000:00010000:0.0:1787599490.276960:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599490.597003:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578004480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599490.597083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599490.597215:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004480 00000100:00100000:1.0:1787599490.597224:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004480 00000100:00100000:1.0:1787599490.597278:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787599490.597288:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578004480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599490.597316:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599490.597373:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578004480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.597380:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787599490.597425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578004480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599490.597444:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599490.597452:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599490.597481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599490.597512:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004352 00000100:00100000:1.0:1787599490.597515:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004352 00000100:00100000:1.0:1787599490.597536:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787599490.597542:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578004352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599490.597553:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599490.597582:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578004352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599490.597588:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787599490.597617:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578004352:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1787599491.261285:0:14912:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:24:50 (1787599490) 00010000:00010000:0.0:1787599491.301144:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599491.621978:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599491.622004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578004608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599491.622087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599491.622313:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004608 00000100:00100000:2.0:1787599491.622321:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004608 00000100:00100000:2.0:1787599491.622372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787599491.622382:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578004608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599491.622414:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787599491.622472:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578004608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599491.622479:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787599491.622613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578004608:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787599492.197782:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599492.325329:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599492.709254:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787599492.709264:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787599492.709386:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787599492.709395:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599493.065905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599493.066211:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559082112 00000100:00100000:0.0:1787599493.066222:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559082112 00000100:00100000:0.0:1787599493.066274:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559082240 00000100:00100000:0.0:1787599493.066277:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559082240 00000100:00100000:0.0:1787599493.066313:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1787599493.066325:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559082112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066408:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2406:x1874433559082112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066425:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1787599493.066441:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:0.0:1787599493.066448:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559082240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066470:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559082240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066476:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:0.0:1787599493.066492:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081856 00000100:00100000:0.0:1787599493.066495:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081856 00000100:00100000:0.0:1787599493.066522:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559082368 00000100:00100000:0.0:1787599493.066525:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559082368 00000100:00100000:0.0:1787599493.066537:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081984 00000100:00100000:0.0:1787599493.066539:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081984 00000100:00100000:0.0:1787599493.066551:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559082496 00000100:00100000:0.0:1787599493.066553:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559082496 00000100:00100000:0.0:1787599493.066578:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 355 00000100:00100000:0.0:1787599493.066587:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:2406:x1874433559081856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066614:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+19:2406:x1874433559081856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066620:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 355 00000100:00100000:0.0:1787599493.066632:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 356 00000100:00100000:0.0:1787599493.066637:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2406:x1874433559082368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066660:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2406:x1874433559082368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066675:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 356 00000100:00100000:0.0:1787599493.066688:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 357 00000100:00100000:0.0:1787599493.066693:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559081984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066718:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2406:x1874433559081984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066724:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 357 00000100:00100000:0.0:1787599493.066736:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00100000:0.0:1787599493.066742:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559082496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599493.066768:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2406:x1874433559082496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.066773:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00080000:0.0:1787599493.066829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599493.066833:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599493.066835:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599493.066837:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599493.069642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559081728 00000100:00100000:3.0:1787599493.069658:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559081728 00000100:00100000:2.0:1787599493.070449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 395 00000100:00100000:2.0:1787599493.070463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559081728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599493.070551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559081728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.070559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 395 00000100:00100000:3.0:1787599493.163108:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599493.163135:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578004736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599493.163207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.164098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004736 00000100:00100000:1.0:1787599493.164110:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004736 00000100:00100000:1.0:1787599493.164164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787599493.164174:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578004736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599493.164208:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599493.164268:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578004736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.164275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787599493.165706:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578004736:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599493.352292:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599494.375597:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599494.805028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599494.805124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559082752 00000100:00100000:2.0:1787599494.805134:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559082752 00000100:00100000:2.0:1787599494.805199:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1787599494.805211:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+19:13182:x1874433559082752:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1787599494.805460:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+20:13182:x1874433559082752:12345-192.168.202.1@tcp:35:umount.0 Request processed in 250us (441us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787599494.805468:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1787599494.809914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599494.810008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083008 00000100:00100000:3.0:1787599494.810018:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083008 00000100:00100000:3.0:1787599494.810078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1787599494.810097:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+20:13182:x1874433559083008:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:3.0:1787599494.810385:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:13182:x1874433559083008:12345-192.168.202.1@tcp:35:umount.0 Request processed in 296us (481us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787599494.810392:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1787599494.815684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599494.815785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083264 00000100:00100000:3.0:1787599494.815830:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083264 00000100:00100000:3.0:1787599494.815907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1787599494.815919:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35320f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+21:13182:x1874433559083264:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:3.0:1787599494.816167:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35320f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+22:13182:x1874433559083264:12345-192.168.202.1@tcp:35:umount.0 Request processed in 250us (498us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787599494.816176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1787599494.820486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599494.820873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083520 00000100:00100000:2.0:1787599494.820895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083520 00000100:00100000:2.0:1787599494.820959:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1787599494.820984:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+22:13182:x1874433559083520:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1787599494.821266:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4ef2ef44-63df-45fd-9e68-c54398cec083+23:13182:x1874433559083520:12345-192.168.202.1@tcp:35:umount.0 Request processed in 284us (789us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787599494.821274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1787599494.829222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599494.829263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599494.829296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599494.829378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083776 00000100:00100000:1.0:1787599494.829400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083776 00000100:00100000:1.0:1787599494.829458:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083648 00000100:00100000:1.0:1787599494.829461:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083648 00000100:00100000:1.0:1787599494.829475:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559083904 00000100:00100000:1.0:1787599494.829478:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559083904 00000100:00100000:1.0:1787599494.829494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599494.829504:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+15:2405:x1874433559083776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599494.829518:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599494.829537:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6000/0x5d2988b0929cf2ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adb9c2 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.829554:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599494.829615:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+14:2405:x1874433559083776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 112us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599494.829622:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599494.829644:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1787599494.829649:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+13:2405:x1874433559083648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599494.829657:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599494.829667:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6800/0x5d2988b0929cf2eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba01 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.829674:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599494.829690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+12:2405:x1874433559083648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599494.829695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1787599494.829707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1787599494.829712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:2405:x1874433559083904:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599494.829728:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599494.829737:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243758e00/0x5d2988b0929cf5bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbada expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.829746:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599494.829775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433559083904:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599494.829781:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599494.834023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599494.834153:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559084032 00000100:00100000:3.0:1787599494.834164:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559084032 00000100:00100000:3.0:1787599494.834229:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1787599494.834239:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2402:x1874433559084032:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:3.0:1787599494.834271:0:8629:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf687 00000100:00080000:3.0:1787599494.834282:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b347dcd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599494.834352:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787599494.834534:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+2:2402:x1874433559084032:12345-192.168.202.1@tcp:9:umount.0 Request processed in 296us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599494.834542:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:1.0:1787599494.834704:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599494.839432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599494.839526:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559084416 00000100:00100000:1.0:1787599494.839536:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559084416 00000100:00100000:1.0:1787599494.839593:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1787599494.839604:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+7:2402:x1874433559084416:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1787599494.839634:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf8fd 00000020:00010000:1.0:1787599494.839642:0:8435:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b351f6d800: total 0 00000100:00080000:1.0:1787599494.839647:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96b351f6a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599494.839695:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:3.0:1787599494.839696:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b351f6d800: total 0 00010000:00010000:3.0:1787599494.839740:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b351f6d800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787599494.839821:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929cfcb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcc4 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599494.839855:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d9af73/0x5d2988b0929d0384 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea7 expref: 4 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599494.839869:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b351f6d800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787599494.839891:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599494.839893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599494.839894:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599494.839924:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+2:2402:x1874433559084416:12345-192.168.202.1@tcp:9:umount.0 Request processed in 321us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599494.839932:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1787599494.850143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599494.850336:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559085440 00000100:00100000:0.0:1787599494.850362:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559085440 00000100:00100000:0.0:1787599494.850537:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:0.0:1787599494.850549:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+23:2402:x1874433559085440:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1787599494.850584:0:10099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf2ba 00000020:00010000:0.0:1787599494.850601:0:10099:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b243460800: total 0 00000100:00080000:0.0:1787599494.850605:0:10099:0:(import.c:65:import_set_state_nolock()) ffff96b243466000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599494.850647:0:10099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1787599494.850971:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4ef2ef44-63df-45fd-9e68-c54398cec083+22:2402:x1874433559085440:12345-192.168.202.1@tcp:39:umount.0 Request processed in 423us (835us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787599494.850979:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 258 00000020:00010000:1.0:1787599494.851032:0:10397:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b243460800: total 0 00010000:00010000:1.0:1787599494.851097:0:10397:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b243460800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1787599494.851131:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599494.851135:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599494.851144:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4800/0x5d2988b0929d0027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbdc0 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.851164:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599494.851176:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787599494.851182:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030600/0x5d2988b0929d036f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbea0 expref: 20 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.851200:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599494.851202:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599494.851206:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340030200/0x5d2988b0929cf65d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbb04 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852073:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599494.852078:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787599494.852085:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d600/0x5d2988b0929cfca0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcbd expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852101:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:1.0:1787599494.852104:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599494.852107:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200d800/0x5d2988b0929cfd1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852119:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b355403700) 00010000:00010000:1.0:1787599494.852121:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599494.852124:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381324e00/0x5d2988b0929cf602 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbaef expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852139:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599494.852141:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599494.852145:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b24200ce00/0x5d2988b0929cfc76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbcaf expref: 15 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852174:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599494.852177:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599494.852181:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031000/0x5d2988b0929d035a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe99 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852193:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff96b242159800) 00010000:00010000:1.0:1787599494.852196:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599494.852199:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758600/0x5d2988b0929cf958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbbdd expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852214:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599494.852227:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599494.852231:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b340031a00/0x5d2988b0929d0265 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe5a expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852244:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b355403e00) 00010000:00010000:1.0:1787599494.852246:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599494.852250:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b381325400/0x5d2988b0929cf5e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbae8 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852264:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96b342bf1900) 00010000:00010000:1.0:1787599494.852266:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599494.852270:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152a000/0x5d2988b0929cfd3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbce7 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852283:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96b35acbb700) 00010000:00010000:1.0:1787599494.852285:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787599494.852295:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b34152ae00/0x5d2988b0929d0337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbe92 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852310:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff96b35acbbe00) 00010000:00010000:1.0:1787599494.852312:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599494.852316:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929cfb96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbc77 expref: 8 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599494.852328:0:10397:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b243460800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787599494.852351:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599494.852354:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599494.852356:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599494.868319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599494.868380:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559085568 00000100:00100000:0.0:1787599494.868391:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559085568 00000100:00100000:0.0:1787599494.868511:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:0.0:1787599494.868522:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+5:2402:x1874433559085568:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1787599494.868554:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf2c1 00000100:00080000:0.0:1787599494.868572:0:6521:0:(import.c:65:import_set_state_nolock()) ffff96b37f8e6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599494.868604:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787599494.868916:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599494.869039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4ef2ef44-63df-45fd-9e68-c54398cec083+3:2402:x1874433559085568:12345-192.168.202.1@tcp:39:umount.0 Request processed in 517us (727us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787599494.869059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:0.0:1787599495.205200:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578004992:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578005248:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205462:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578005760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205511:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578006272:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205558:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787599495.205564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578004864:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578005376:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205648:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578005888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205668:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205681:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578006400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599495.205730:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005248 00000100:00100000:2.0:1787599495.205738:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005248 00000100:00100000:2.0:1787599495.205782:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787599495.205826:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578005248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.205906:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578005248:12345-0@lo:400:kworker.0 Request processed in 116us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.205913:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787599495.205935:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004864 00000100:00100000:2.0:1787599495.205939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004864 00000100:00100000:2.0:1787599495.205967:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787599495.205974:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433578004864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433578004864:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206006:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787599495.206028:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005376 00000100:00100000:2.0:1787599495.206032:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005376 00000100:00100000:2.0:1787599495.206055:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787599495.206061:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578005376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206089:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578005376:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206095:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787599495.206115:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005760 00000100:00100000:2.0:1787599495.206118:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005760 00000100:00100000:2.0:1787599495.206144:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006272 00000100:00100000:2.0:1787599495.206147:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006272 00000100:00100000:2.0:1787599495.206157:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005888 00000100:00100000:2.0:1787599495.206159:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005888 00000100:00100000:2.0:1787599495.206171:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006400 00000100:00100000:2.0:1787599495.206173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006400 00000100:00100000:2.0:1787599495.206185:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599495.206190:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206233:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578005760:12345-0@lo:400:kworker.0 Request processed in 42us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206245:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599495.206258:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599495.206264:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578006272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206292:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578006272:12345-0@lo:400:kworker.0 Request processed in 29us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206298:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599495.206309:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599495.206315:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206339:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578005888:12345-0@lo:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206344:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599495.206354:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599495.206359:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578006400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206382:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578006400:12345-0@lo:400:kworker.0 Request processed in 23us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599495.206386:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599495.206424:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578004864:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206435:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578005376:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206445:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578005888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206454:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578006400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206462:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578005248:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578005760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.206488:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578006272:0@lo:400:kworker.0 00000100:00080000:2.0:1787599495.206529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599495.206534:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599495.207134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207170:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578005504:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207442:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578006016:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207501:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787599495.207508:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578005120:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207551:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578005632:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207586:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578006144:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.207635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005120 00000100:00100000:0.0:1787599495.207641:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005120 00000100:00100000:0.0:1787599495.207675:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787599495.207683:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578005120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.207727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578005120:12345-0@lo:400:kworker.0 Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.207733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787599495.207753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578004992 00000100:00100000:0.0:1787599495.207757:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578004992 00000100:00100000:0.0:1787599495.207773:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005504 00000100:00100000:0.0:1787599495.207775:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005504 00000100:00100000:0.0:1787599495.207827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006016 00000100:00100000:0.0:1787599495.207831:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006016 00000100:00100000:0.0:1787599495.207845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578005632 00000100:00100000:0.0:1787599495.207847:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578005632 00000100:00100000:0.0:1787599495.207858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006144 00000100:00100000:0.0:1787599495.207860:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006144 00000100:00100000:0.0:1787599495.207871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787599495.209024:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787599495.209039:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.209406:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578005504:12345-0@lo:400:kworker.0 Request processed in 372us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.209502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578004992:12345-0@lo:400:kworker.0 Request processed in 1666us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.209550:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787599495.209585:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787599495.209592:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578006016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578006016:12345-0@lo:400:kworker.0 Request processed in 34us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.209630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787599495.209641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787599495.209648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578005632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578005632:12345-0@lo:400:kworker.0 Request processed in 28us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.209680:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787599495.209691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787599495.209698:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209727:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578006144:12345-0@lo:400:kworker.0 Request processed in 30us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.209733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:0.0:1787599495.209750:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599495.209754:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599495.209820:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578005120:0@lo:400:kworker.0 00010000:00080000:0.0:1787599495.209837:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c1c00 x1874433578005632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599495.209847:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578005632:0@lo:400:kworker.0 00010000:00080000:0.0:1787599495.209857:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c3480 x1874433578006144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599495.209864:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578006144:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209897:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578004992:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209907:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578005504:0@lo:400:kworker.0 00000100:00100000:0.0:1787599495.209915:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578006016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599495.210003:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787599495.210553:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578006528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599495.210593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599495.211884:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006528 00000100:00100000:1.0:1787599495.211896:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006528 00000100:00100000:1.0:1787599495.211950:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787599495.211959:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578006528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599495.211987:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787599495.212065:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578006528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599495.212072:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787599495.212462:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578006528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599495.213705:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599495.213722:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578006656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599495.213773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599495.214004:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006656 00000100:00100000:0.0:1787599495.214011:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006656 00000100:00100000:1.0:1787599495.215537:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787599495.215557:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578006656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599495.215586:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787599495.215660:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578006656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599495.215667:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599495.216091:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578006656:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787599495.397067:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599495.717994:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578006784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599495.718161:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599495.718232:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599495.718239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578006912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599495.718262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599495.718294:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006784 00000100:00100000:3.0:1787599495.718301:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006784 00000100:00100000:3.0:1787599495.718339:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578006912 00000100:00100000:3.0:1787599495.718342:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578006912 00000100:00100000:3.0:1787599495.718375:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787599495.718431:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578006784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599495.718460:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787599495.718520:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578006784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599495.718581:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578006784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599495.720008:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599495.720030:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578006912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599495.720050:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787599495.720110:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578006912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599495.720116:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599495.720236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578006912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599495.725150:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:3.0:1787599496.423368:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599496.744031:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599496.744057:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578007040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599496.744142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599496.744462:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007040 00000100:00100000:2.0:1787599496.744472:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007040 00000100:00100000:2.0:1787599496.744534:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787599496.744543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578007040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599496.744578:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787599496.745079:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578007040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 535us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599496.745088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787599496.748904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578007040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599496.974560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599496.974629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599496.976186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599496.976486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559085696 00000100:00100000:2.0:1787599496.976496:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559085696 00000100:00100000:2.0:1787599496.976555:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559085952 00000100:00100000:2.0:1787599496.976557:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559085952 00000100:00100000:2.0:1787599496.976586:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1787599496.976593:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+11:2405:x1874433559085696:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599496.976604:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599496.976619:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340031e00/0x5d2988b0929cf3bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba16 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599496.976634:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599496.976674:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+10:2405:x1874433559085696:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 82us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599496.976678:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1787599496.976690:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599496.976694:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+9:2405:x1874433559085952:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599496.976698:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599496.976704:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b340030400/0x5d2988b0929cf5b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbad3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599496.976711:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599496.976729:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:2405:x1874433559085952:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 35us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599496.976733:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599496.977169:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559085824 00000100:00100000:2.0:1787599496.977175:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559085824 00000100:00100000:2.0:1787599496.977216:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1787599496.977223:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787599496.977224:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+8:2405:x1874433559085824:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787599496.977232:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787599496.977232:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599496.977242:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7200/0x5d2988b0929cf3c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba47 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599496.977263:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599496.977289:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd78f288-8599-4a39-80e2-c718c7b7c2ac+7:2405:x1874433559085824:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 65us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599496.977295:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599496.977456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599496.977517:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086208 00000100:00100000:2.0:1787599496.977521:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086208 00000100:00100000:2.0:1787599496.977576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:2.0:1787599496.977583:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+6:2402:x1874433559086208:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:2.0:1787599496.977616:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf3d2 00000020:00010000:2.0:1787599496.977623:0:6522:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b24335c000: total 0 00000100:00080000:2.0:1787599496.977627:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96b243358000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599496.977649:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1787599496.977778:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2402:x1874433559086208:12345-192.168.202.1@tcp:39:umount.0 Request processed in 195us (322us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787599496.977786:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00000020:00010000:2.0:1787599496.977932:0:10397:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b24335c000: total 0 00010000:00010000:2.0:1787599496.977971:0:10397:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b24335c000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787599496.977998:0:10397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242e62b00) 00010000:00010000:2.0:1787599496.978002:0:10397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599496.978008:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5200/0x5d2988b0929d0392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeae expref: 4 pid: 13004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599496.978032:0:10397:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b24335c000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787599496.978043:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599496.978045:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599496.978047:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599496.978512:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599496.983174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599496.983293:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086336 00000100:00100000:0.0:1787599496.983302:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086336 00000100:00100000:0.0:1787599496.983380:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:0.0:1787599496.983388:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+5:2402:x1874433559086336:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1787599496.983419:0:13004:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf3d9 00000100:00080000:0.0:1787599496.983426:0:13004:0:(import.c:65:import_set_state_nolock()) ffff96b2430ba000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599496.983471:0:13004:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787599496.983605:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e17efe0f-8a41-4104-9ca3-3518d13d3cfe+3:2402:x1874433559086336:12345-192.168.202.1@tcp:39:umount.0 Request processed in 217us (440us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787599496.983611:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00010000:00010000:3.0:1787599496.983972:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599496.984089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599497.016501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599497.016667:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086592 00000100:00100000:0.0:1787599497.016677:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086592 00000100:00100000:0.0:1787599497.016900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 397 00000100:00100000:0.0:1787599497.016912:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+7:2402:x1874433559086592:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:0.0:1787599497.016964:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf297 00000020:00010000:0.0:1787599497.016972:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b242dfa800: total 0 00000100:00080000:0.0:1787599497.016976:0:6512:0:(import.c:65:import_set_state_nolock()) ffff96b242dfe000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787599497.017060:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ece3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd78f288-8599-4a39-80e2-c718c7b7c2ac+3:2402:x1874433559086592:12345-192.168.202.1@tcp:251:umount.0 Request processed in 150us (569us total) trans 0 rc 0/0 00000020:00010000:1.0:1787599497.017112:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b242dfa800: total 0 00010000:00010000:1.0:1787599497.017116:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599497.017173:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b242dfa800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787599497.017211:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381325800/0x5d2988b0929cf2f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adba08 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599497.017226:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b242dfa800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787599497.017236:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599497.017237:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599497.017239:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599497.023388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 397 00000020:00000080:0.0:1787599497.023413:0:6512:0:(genops.c:885:class_export_put()) final put ffff96b242dfa800/dd78f288-8599-4a39-80e2-c718c7b7c2ac 00000020:00000080:2.0:1787599497.023607:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b242dfa800/dd78f288-8599-4a39-80e2-c718c7b7c2ac for MGS 00000020:00000080:2.0:1787599497.031335:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b242dfe000 for MGS 00010000:00010000:3.0:1787599497.462127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599498.282936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599498.282961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578007168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599498.283054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599498.283346:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007168 00000100:00100000:1.0:1787599498.283356:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007168 00000100:00100000:1.0:1787599498.283411:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787599498.283421:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578007168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599498.283455:0:7828:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787599498.283512:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578007168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599498.283519:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787599498.283605:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578007168:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1787599498.289158:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00080000:2.0:1787599498.289236:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787599498.289242:0:6499:0:(genops.c:885:class_export_put()) final put ffff96b24335c000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00100000:2.0:1787599498.289374:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000001:00080000:2.0:1787599498.289381:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787599498.289393:0:6499:0:(genops.c:885:class_export_put()) final put ffff96b243460800/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:0.0:1787599498.289419:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24335c000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe for lustre-MDT0000 00000020:00000080:0.0:1787599498.289483:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b243358000 for lustre-MDT0000 00000020:00000080:3.0:1787599498.289956:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b243460800/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-MDT0000 00000020:00000080:3.0:1787599498.290256:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b243466000 for lustre-MDT0000 00010000:00010000:2.0:1787599498.473297:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599499.002717:0:15109:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787599499.027345:0:15109:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787599499.027418:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027434:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027443:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027450:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027493:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787599499.027500:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787599499.027539:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599499.027545:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027553:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599499.027556:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027565:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599499.027572:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599499.027579:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599499.027581:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787599499.027583:0:10398:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787599499.027622:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027628:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599499.027670:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027678:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497000/0x5d2988b0929cf34d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf354 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.027691:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.027699:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.027701:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599499.027717:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599499.027722:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787599499.027729:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787599499.027742:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787599499.027849:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599499.027939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599499.028041:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578007424:0@lo:39:umount.0 00000100:00100000:1.0:1787599499.028076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599499.028959:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007296 00000100:00100000:3.0:1787599499.028970:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007296 00000100:00100000:3.0:1787599499.029027:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599499.029038:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3647:x1874433578007296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.029052:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599499.029072:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381325a00/0x5d2988b0929cf354 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf34d expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.029087:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599499.029431:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3647:x1874433578007296:12345-0@lo:103:ldlm_bl.0 Request processed in 393us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599499.029439:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599499.029629:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007424 00000100:00100000:2.0:1787599499.029634:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007424 00000100:00100000:2.0:1787599499.029687:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787599499.029696:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874433578007424:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787599499.029720:0:10099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929ceeae 00000100:00080000:2.0:1787599499.029728:0:10099:0:(import.c:65:import_set_state_nolock()) ffff96b3434d0800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787599499.029813:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1874433578007424:12345-0@lo:39:umount.0 Request processed in 98us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599499.029820:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787599499.029828:0:10099:0:(genops.c:885:class_export_put()) final put ffff96b3434d4800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787599499.029861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599499.029893:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787599499.029903:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578007424:0@lo:39:umount.0 00000020:00000080:2.0:1787599499.029945:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787599499.030258:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599499.030262:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787599499.030267:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787599499.031540:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031557:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031566:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031589:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031612:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599499.031627:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599499.031632:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031639:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599499.031734:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031745:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599499.031753:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599499.031759:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599499.031761:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787599499.031815:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031821:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599499.031852:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031859:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929cf35b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf362 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.031887:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.031889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.031900:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031972:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031980:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.031987:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032123:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599499.032131:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032139:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032145:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032151:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032163:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599499.032177:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599499.032181:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032188:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3821d1a00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599499.032192:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032199:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599499.032205:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599499.032211:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599499.032213:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787599499.032216:0:10398:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787599499.032232:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032239:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599499.032254:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032260:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3821d1a00/0x5d2988b0929cf251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032271:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599499.032274:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032279:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599499.032288:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032295:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599499.032301:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599499.032306:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787599499.032308:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787599499.032310:0:10398:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787599499.032325:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032330:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599499.032337:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032343:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c600/0x5d2988b0929cf5a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.032354:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.032356:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.032721:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599499.032743:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578007680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599499.032839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599499.032901:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599499.032974:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578007808:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787599499.033111:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d0800 for lustre-MDT0000 00010000:00010000:2.0:1787599499.033140:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599499.034471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599499.034531:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007680 00000100:00100000:3.0:1787599499.034539:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007680 00000100:00100000:3.0:1787599499.034586:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007808 00000100:00100000:3.0:1787599499.034589:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007808 00000100:00100000:3.0:1787599499.034610:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599499.034619:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+24:3645:x1874433578007680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.034633:0:15023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787599499.034859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599499.034881:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599499.034896:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.035090:0:15023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d0e00/0x5d2988b0929cf258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf251 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035108:0:15023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599499.035159:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+23:3645:x1874433578007680:12345-0@lo:103:ldlm_bl.0 Request processed in 541us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599499.035167:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599499.035186:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599499.035193:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+22:3645:x1874433578007808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.035201:0:15023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599499.035211:0:15023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200d000/0x5d2988b0929cf5ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf5a7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035221:0:15023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599499.035242:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3645:x1874433578007808:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599499.035248:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599499.035279:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578007808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599499.035288:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578007680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.035313:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035329:0:15109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035336:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035343:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599499.035556:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787599499.035564:0:15109:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787599499.035568:0:15109:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787599499.035604:0:15109:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787599499.035608:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787599499.035613:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599499.035618:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1787599499.035623:0:15109:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b2419cc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599499.035629:0:15109:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b37bb49000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599499.035634:0:15109:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b381b77800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599499.035638:0:15109:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b38112f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1787599499.035643:0:15109:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff96b34dcfb370) has exports, disconnecting them 00000020:00080000:3.0:1787599499.035720:0:15109:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b2419cc000), last request at 1787599495 00000020:00000080:3.0:1787599499.035729:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf1c5 00000100:00080000:3.0:1787599499.035746:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b2419cf800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787599499.035808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599499.035858:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007552 00000100:00100000:1.0:1787599499.035864:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007552 00000100:00100000:1.0:1787599499.035899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599499.035907:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+21:3647:x1874433578007552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599499.035928:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599499.035939:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341496000/0x5d2988b0929cf362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf35b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599499.035950:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599499.035978:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3647:x1874433578007552:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599499.035984:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599499.036193:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599499.036481:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599499.036489:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599499.036497:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341496200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599499.036500:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599499.036509:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599499.036517:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599499.036522:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787599499.036525:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787599499.036527:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787599499.036554:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599499.036560:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599499.036593:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599499.036599:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341496200/0x5d2988b0929cee0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cee14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599499.036611:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599499.036612:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599499.036614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599499.038181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599499.038250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599499.038316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578007936 00000100:00100000:1.0:1787599499.038323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578007936 00000100:00100000:1.0:1787599499.038380:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599499.038389:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+20:3647:x1874433578007936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599499.038401:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599499.038418:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3821d1e00/0x5d2988b0929cee14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cee0d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599499.038438:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599499.038471:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:3647:x1874433578007936:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599499.038489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599499.038527:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578007936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599499.039735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787599499.039754:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b2419cc000): rc 0 00000020:00000080:3.0:1787599499.039759:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b2419cc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787599499.039786:0:15109:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b37bb49000), last request at 1787599495 00000020:00000080:3.0:1787599499.039811:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf098 00000100:00080000:3.0:1787599499.039821:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b37bb4f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787599499.039835:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787599499.039853:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b37bb49000): rc 0 00000020:00000080:3.0:1787599499.039856:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b37bb49000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787599499.039860:0:15109:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b381b77800), last request at 1787599266 00000020:00000080:3.0:1787599499.039863:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef95 00000100:00080000:3.0:1787599499.039866:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b381b70000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787599499.039875:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b381b77800): rc 0 00000020:00000080:3.0:1787599499.039877:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b381b77800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787599499.039881:0:15109:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b38112f000), last request at 1787599266 00000020:00000080:3.0:1787599499.039883:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef56 00000100:00080000:3.0:1787599499.039886:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b38112a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599499.039895:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1787599499.039995:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b38112f000): rc 0 00000004:00000080:3.0:1787599499.040002:0:15109:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb144146bae0 00000100:00080000:3.0:1787599499.040260:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787599499.040264:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1787599499.041440:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787599499.041471:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b381128800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787599499.042380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.042388:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599499.042400:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419cc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787599499.042454:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37bb49000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787599499.042479:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381b77800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787599499.042500:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2419cf800 for lustre-MDT0000 00000020:00000080:3.0:1787599499.042505:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37bb4f000 for lustre-MDT0000 00000020:00000080:3.0:1787599499.042524:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b381b70000 for lustre-MDT0000 00000100:00100000:2.0:1787599499.042755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008064:0@lo:39:umount.0 00000100:00100000:2.0:1787599499.043253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599499.045071:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008064 00000100:00100000:0.0:1787599499.045091:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008064 00000100:00100000:0.0:1787599499.045168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787599499.045179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578008064:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787599499.045213:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929ceff0 00000100:00080000:0.0:1787599499.045222:0:6525:0:(import.c:65:import_set_state_nolock()) ffff96b3812c8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599499.045247:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787599499.045438:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3644:x1874433578008064:12345-0@lo:39:umount.0 Request processed in 260us (2185us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787599499.045445:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:0.0:1787599499.045471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599499.045778:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b381128800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787599499.045788:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008064:0@lo:39:umount.0 00000100:00080000:2.0:1787599499.046292:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787599499.046297:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787599499.046308:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787599499.047544:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787599499.047577:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787599499.047611:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787599499.047615:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787599499.047627:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599499.048139:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008192:0@lo:9:umount.0 00000100:00100000:0.0:1787599499.048207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599499.049125:0:15109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787599499.049151:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787599499.049197:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96b34dcfb370) has no exports 00000100:00100000:1.0:1787599499.049288:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008192 00000100:00100000:1.0:1787599499.049299:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008192 00000100:00100000:0.0:1787599499.049491:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008320:0@lo:9:umount.0 00000100:00100000:0.0:1787599499.049544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599499.049577:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599499.052479:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008320 00000100:00100000:1.0:1787599499.052492:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008320 00000100:00100000:1.0:1787599499.052557:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787599499.052568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578008192:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787599499.052599:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf147 00000100:00080000:1.0:1787599499.052609:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96b377b3f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787599499.052726:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787599499.052737:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578008320:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787599499.052751:0:8629:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf290 00000100:00080000:3.0:1787599499.052758:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b243463800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599499.052884:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787599499.053165:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1874433578008320:12345-0@lo:9:umount.0 Request processed in 430us (3620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599499.053173:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1787599499.053202:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787599499.053589:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787599499.053751:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3644:x1874433578008192:12345-0@lo:9:umount.0 Request processed in 1184us (5543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599499.053759:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1787599499.054308:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599499.054445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599499.054485:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787599499.054501:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787599499.054503:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599499.054508:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008320:0@lo:9:umount.0 00000100:00080000:0.0:1787599499.054522:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b37f8b4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787599499.054532:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787599499.054533:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599499.054536:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3483ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578008192:0@lo:9:umount.0 00000020:00080000:0.0:1787599499.065523:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96b34dcfb370) has no exports 00000020:00000080:0.0:1787599499.134879:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee68 00000020:00000080:0.0:1787599499.134894:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b381129800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787599499.134952:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787599499.135306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381129800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787599499.135329:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599499.135339:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599499.135344:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff96b3810dcd28) has no exports 00000020:00000080:1.0:1787599499.136137:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee61 00000020:00000080:1.0:1787599499.136145:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3810c8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599499.136272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3810c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787599499.136449:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599499.136458:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787599499.136460:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3810ca800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787599499.136463:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3810ca800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787599499.136467:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787599499.493239:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599500.326140:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578008448:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.326215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.326264:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578008960:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.326284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.326302:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578009472:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.326316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.326325:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787599500.326328:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578008832:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.326341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.326358:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578009344:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.326387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.326423:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008960 00000100:00100000:2.0:1787599500.326431:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008960 00000100:00100000:1.0:1787599500.326434:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008832 00000100:00100000:1.0:1787599500.326441:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008832 00000100:00100000:1.0:1787599500.326494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009344 00000100:00100000:1.0:1787599500.326498:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009344 00000100:00100000:3.0:1787599500.326527:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578008576:0@lo:400:kworker.0 00000100:00100000:3.0:1787599500.326551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599500.326566:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578009088:0@lo:400:kworker.0 00000100:00100000:3.0:1787599500.326576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599500.326585:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578009600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599500.326597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599500.326608:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787599500.326611:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578008704:0@lo:400:kworker.0 00000100:00100000:3.0:1787599500.326622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599500.327670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008448 00000100:00100000:0.0:1787599500.327681:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008448 00000100:00100000:0.0:1787599500.327743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787599500.327755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:3648:x1874433578008448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599500.327862:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34dc5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06cde0c1-6e67-4be0-92c4-a9f33549d8e6+19:3648:x1874433578008448:12345-0@lo:400:kworker.0 Request processed in 109us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599500.327893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:0.0:1787599500.327927:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599500.327957:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009472 00000100:00100000:0.0:1787599500.327961:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009472 00000100:00100000:0.0:1787599500.327990:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009088 00000100:00100000:0.0:1787599500.327993:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009088 00000100:00100000:0.0:1787599500.328011:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787599500.328017:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599500.328053:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578009472:12345-0@lo:400:kworker.0 Request processed in 36us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599500.328059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787599500.328081:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599500.328088:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578009088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599500.328119:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578009088:12345-0@lo:400:kworker.0 Request processed in 32us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599500.328124:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787599500.330536:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578009216:0@lo:400:kworker.0 00000100:00100000:3.0:1787599500.331197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599500.331287:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008704 00000100:00100000:2.0:1787599500.331295:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008704 00000100:00100000:2.0:1787599500.331335:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787599500.331347:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578008960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599500.331377:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787599500.331390:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578009344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.331418:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3483ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578008960:12345-0@lo:400:kworker.0 Request processed in 74us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599500.331426:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787599500.331445:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787599500.331449:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1874433578008832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787599500.331455:0:13004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787599500.331479:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1874433578008832:12345-0@lo:400:kworker.0 Request processed in 29us (5138us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599500.331482:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787599500.331492:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787599500.331495:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1874433578008704:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787599500.331497:0:13004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787599500.331509:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1874433578008704:12345-0@lo:400:kworker.0 Request processed in 13us (4886us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599500.331512:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1787599500.331720:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787599500.331724:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787599500.331727:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787599500.331936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599500.331942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599500.332027:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578009344:12345-0@lo:400:kworker.0 Request processed in 632us (5630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599500.332035:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787599500.332281:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009600 00000100:00100000:1.0:1787599500.332287:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009600 00000100:00100000:1.0:1787599500.332326:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787599500.332333:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578009600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599500.332382:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787599500.332420:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578009600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599500.332426:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787599500.332447:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578008576 00000100:00100000:1.0:1787599500.332451:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578008576 00000100:00100000:0.0:1787599500.332653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787599500.332659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1874433578008576:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787599500.332665:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787599500.332961:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1874433578008576:12345-0@lo:400:kworker.0 Request processed in 300us (6407us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787599500.332978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000001:00100000:0.0:1787599500.333664:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787599500.333668:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b377b3e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787599500.333687:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:1.0:1787599500.333709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b3e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787599500.333775:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b351f6d800/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:1.0:1787599500.333877:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b377b3f800 for lustre-OST0000 00000020:00000080:1.0:1787599500.333883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b351f6d800/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-OST0000 00000020:00000080:1.0:1787599500.333908:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b351f6a000 for lustre-OST0000 00000100:00100000:0.0:1787599500.338912:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009216 00000100:00100000:0.0:1787599500.338926:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009216 00000100:00080000:3.0:1787599500.338935:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787599500.338943:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787599500.338949:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787599500.338968:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599500.338971:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1787599500.338977:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b378218000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599500.338982:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787599500.338991:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1874433578009216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787599500.339000:0:13004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787599500.339016:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b35176aa00 x1874433578009728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599500.339050:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578008576:0@lo:400:kworker.0 00000100:00100000:0.0:1787599500.339079:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1874433578009216:12345-0@lo:400:kworker.0 Request processed in 77us (7872us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787599500.339087:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787599500.339176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578009728:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787599500.339216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599500.339364:0:7828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009728 00000100:00100000:0.0:1787599500.339367:0:7828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009728 00000100:00100000:0.0:1787599500.339388:0:7828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787599500.339393:0:7828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874433578009728:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787599500.339426:0:7828:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787599500.340496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578009088:0@lo:400:kworker.0 00000100:00100000:3.0:1787599500.340517:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578009600:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787599500.340544:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787599500.340548:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787599500.340552:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787599500.340556:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599500.340560:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1787599500.340565:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b381b74000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599500.340587:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b351769880 x1874433578009856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599500.340612:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578008704:0@lo:400:kworker.0 00000100:00080000:3.0:1787599500.340624:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787599500.340627:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787599500.340630:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787599500.340659:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578009856:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787599500.340702:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599500.340758:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009856 00000100:00100000:1.0:1787599500.340763:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009856 00000100:00100000:1.0:1787599500.340804:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787599500.340811:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874433578009856:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787599500.340823:0:10099:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787599500.340868:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874433578009856:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787599500.340886:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1787599500.340912:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599500.340916:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599500.340919:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578009856:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787599500.342972:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599500.342997:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 259 00000100:00080000:3.0:1787599500.343006:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b2430b8800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599500.343045:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b35176a300 x1874433578009984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599500.343623:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578009984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787599500.343710:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578009216:0@lo:400:kworker.0 00000100:00100000:1.0:1787599500.343925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599500.344493:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578009984 00000100:00100000:1.0:1787599500.344503:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578009984 00000100:00100000:1.0:1787599500.344610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787599500.344619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578009984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787599500.344650:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787599500.344709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578009984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 88us (783us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787599500.346164:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599500.346188:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 233 00000100:00080000:2.0:1787599500.346196:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b2419da000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599500.346297:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b37f87ea00 x1874433578010112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599500.346318:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578008832:0@lo:400:kworker.0 00010000:00080000:2.0:1787599500.346360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138c700 x1874433578009344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599500.346380:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578009344:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.346401:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578009472:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.346418:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578008448:0@lo:400:kworker.0 00010000:00080000:2.0:1787599500.346430:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c3480 x1874433578008960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599500.346439:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578008960:0@lo:400:kworker.0 00000100:00100000:2.0:1787599500.346504:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578010112:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787599500.346569:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599500.346624:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599500.346630:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599500.346633:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578009984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787599500.346684:0:13004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010112 00000100:00100000:2.0:1787599500.346690:0:13004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010112 00000100:00100000:1.0:1787599500.348510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000001:00100000:3.0:1787599500.349186:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787599500.349199:0:9515:0:(genops.c:885:class_export_put()) final put ffff96b243464000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787599500.349233:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:3.0:1787599500.349237:0:9515:0:(genops.c:885:class_export_put()) final put ffff96b347dce000/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:1.0:1787599500.349481:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b243464000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787599500.349531:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b347dce000/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-OST0001 00000020:00000080:1.0:1787599500.349552:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b243463800 for lustre-OST0001 00000020:00000080:1.0:1787599500.349557:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b347dcd000 for lustre-OST0001 00000100:00100000:2.0:1787599500.349939:0:13004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787599500.349950:0:13004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1874433578010112:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787599500.350013:0:13004:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787599500.350129:0:13004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1874433578010112:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 179us (3568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599500.350136:0:13004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1787599500.350214:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599500.350221:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599500.350225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37f87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578010112:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:2.0:1787599500.359352:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787599500.359368:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787599500.359383:0:7450:0:(genops.c:885:class_export_put()) final put ffff96b377a81000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787599500.359401:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00080000:2.0:1787599500.359405:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787599500.359407:0:7450:0:(genops.c:885:class_export_put()) final put ffff96b2430bf000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe 00000001:00100000:2.0:1787599500.359412:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4ef2ef44-63df-45fd-9e68-c54398cec083 00000001:00080000:2.0:1787599500.359415:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787599500.359417:0:7450:0:(genops.c:885:class_export_put()) final put ffff96b243467800/4ef2ef44-63df-45fd-9e68-c54398cec083 00000020:00000080:3.0:1787599500.359575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377a81000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787599500.359631:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430bf000/e17efe0f-8a41-4104-9ca3-3518d13d3cfe for lustre-MDT0001 00000020:00000080:3.0:1787599500.359662:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b243467800/4ef2ef44-63df-45fd-9e68-c54398cec083 for lustre-MDT0001 00000020:00000080:3.0:1787599500.359682:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3812c8800 for lustre-MDT0001 00000020:00000080:3.0:1787599500.359686:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2430ba000 for lustre-MDT0001 00000020:00000080:3.0:1787599500.359689:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37f8e6000 for lustre-MDT0001 00000100:00100000:0.0:1787599500.362099:0:7828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874433578009728:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 22691us (22869us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599500.362116:0:7828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:2.0:1787599500.364330:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599500.364344:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599500.364349:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578009728:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787599500.517017:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599500.837771:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578010240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599500.837913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599500.838020:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010240 00000100:00100000:1.0:1787599500.838030:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010240 00000100:00100000:1.0:1787599500.838093:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787599500.838105:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578010240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599500.838138:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599500.838195:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578010240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599500.838203:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787599500.838284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578010240:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787599501.541913:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599502.437508:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599502.565540:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599503.589708:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787599504.429714:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787599504.429725:0:6499:0:(genops.c:885:class_export_put()) final put ffff96b38112f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599504.429820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b38112f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787599504.429885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b38112a800 for lustre-MDT0000 00010000:00010000:0.0:1787599504.613007:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787599505.189146:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242ffb9c0 - data ffff96b36633ea20/ffff96b379d6b000 00000020:01000000:1.0:1787599505.189351:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b358d98180 - data ffff96b3661735e8/ffff96b381104800 00000001:00000004:1.0:1787599505.195582:0:15109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787599505.286754:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787599505.286764:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787599505.286779:0:15109:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff96b351768700 x1874433578008064/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787599509 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599505.286843:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787599505.297292:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787599505.297415:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787599505.297436:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599505.297439:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787599505.297728:0:8627:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787599505.297733:0:8627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787599505.297743:0:8627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787599505.298671:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787599505.298676:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787599505.298695:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599505.298698:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787599505.308006:0:9987:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787599505.308038:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787599505.308057:0:9987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787599505.311539:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee30 00000020:00000080:1.0:1787599505.311552:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434be000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599505.313675:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434be000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787599505.314766:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee45 00000020:00000080:1.0:1787599505.314777:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434bf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787599505.315081:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787599505.315088:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599505.315098:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599505.315102:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff96b34dcf8000) has no exports 00000004:01000000:1.0:1787599505.315292:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787599505.315314:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf27b 00000020:00000080:1.0:1787599505.315320:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b2434d0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787599505.322178:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434bf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787599505.322686:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787599505.323144:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787599505.323172:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599505.323188:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787599505.323193:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff96b37f8999b8) has no exports 00000020:00000080:0.0:1787599505.323203:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf274 00000020:00000080:0.0:1787599505.323211:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b37f8b3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787599505.323373:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f8b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787599505.323783:0:15109:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787599505.323876:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599505.323881:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787599505.323888:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599505.323892:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599505.323982:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599505.323991:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787599505.324000:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf139 00000020:00000080:0.0:1787599505.324006:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b377b8b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599505.331863:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37f8b1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787599505.331883:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b37f8b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599505.331886:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f8b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787599505.331894:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787599505.332247:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787599505.332255:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599505.332268:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599505.332272:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff96b37f898000) has no exports 00000020:00000080:0.0:1787599505.332280:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf132 00000020:00000080:0.0:1787599505.332287:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b381b73800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787599505.332698:0:15109:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787599505.332704:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599505.332709:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787599505.332716:0:15109:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599505.332718:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599505.332750:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599505.332769:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787599505.332785:0:15109:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787599505.332823:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cefe9 00000020:00000080:0.0:1787599505.332830:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b376561800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787599505.332835:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787599505.332838:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599505.332843:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599505.332845:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff96b3706f0000) has no exports 00000020:00000080:0.0:1787599505.332850:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cefe2 00000020:00000080:0.0:1787599505.332852:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b38112e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787599505.335586:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b8b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787599505.335606:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381b73800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787599505.335614:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37f8b4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787599505.335628:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b2419dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599505.335631:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787599505.335635:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599505.335722:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b376561800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787599505.335729:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b38112e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787599505.349143:0:15109:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787599505.349154:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599505.349158:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787599505.349167:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599505.349238:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.349252:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599505.349279:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.349282:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599505.349288:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434ba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599505.349293:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434ba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787599505.349310:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599505.349424:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee4c 00000020:00000080:1.0:1787599505.349432:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434b8800/lustre-MDD0000_UUID 00000020:01000000:1.0:1787599505.349437:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787599505.349441:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599505.349446:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599505.349450:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff96b34dcfcd28) has no exports 00000020:00000080:1.0:1787599505.349473:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.349476:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787599505.349480:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cee53 00000020:00000080:1.0:1787599505.349483:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434be800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787599505.349492:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3707b1000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787599505.349495:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3707b1000 3 00000020:01000004:1.0:1787599505.349498:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b3707b1000 from lustre-MDT0000 00000020:00000080:1.0:1787599505.349592:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.349597:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787599505.349600:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434b9800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787599505.349602:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434b9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787599505.349609:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787599505.349641:0:15109:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787599505.349645:0:15109:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787599505.349659:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787599505.349662:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599505.349664:0:15109:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599505.349671:0:15109:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff96b3707b2000 06cde0c1-6e67-4be0-92c4-a9f33549d8e6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599505.349675:0:15109:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff96b3707bcd28) has exports, disconnecting them 00000020:00080000:1.0:1787599505.349679:0:15109:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96b3707b2000), last request at 1787599246 00000020:00000080:1.0:1787599505.349692:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cedf1 00000020:00010000:1.0:1787599505.349696:0:15109:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b3707b2000: total 2 00000100:00080000:1.0:1787599505.349700:0:15109:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787599505.349710:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b3707b2000): rc 0 00000020:00080000:1.0:1787599505.349714:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff96b3707bcd28) has no exports 00000020:00010000:3.0:1787599505.350238:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b3707b2000: total 2 00010000:00010000:3.0:1787599505.350282:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b3707b2000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787599505.350325:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929cf32a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf323 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350352:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6600/0x5d2988b0929cf338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf331 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350364:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a600/0x5d2988b0929ceeed lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929ceee6 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152b200/0x5d2988b0929ceefb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929ceef4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350391:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759a00/0x5d2988b0929cf584 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf57d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350400:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759600/0x5d2988b0929cf592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf58b expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350422:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324a00/0x5d2988b0929cf346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf33f expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350433:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200dc00/0x5d2988b0929cf300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf2f9 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350442:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7c00/0x5d2988b0929cf212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf20b expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350454:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b381324800/0x5d2988b0929cf5a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf599 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350466:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497200/0x5d2988b0929cf370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf369 expref: 4 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350477:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200de00/0x5d2988b0929cf30e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf307 expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350487:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b341497c00/0x5d2988b0929cf31c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929cf315 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599505.350499:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b3707b2000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787599505.350669:0:6508:0:(genops.c:885:class_export_put()) final put ffff96b3707b2000/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 00010000:00010000:3.0:1787599505.350677:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599505.350679:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599505.350681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599505.350693:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b381128800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787599505.350700:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b376563800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787599505.350702:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b376563800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787599505.350718:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787599505.350765:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434b8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787599505.350769:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b3434b8000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787599505.350771:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434b8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787599505.350868:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787599505.350900:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787599505.350906:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3707b2000/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 for MGS 00000020:00000080:3.0:1787599505.350932:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3707b2800 for MGS 00000100:00100000:2.0:1787599505.351332:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff96b35158ae00:6514] 1 exiting: rc = 0 00000100:00100000:1.0:1787599505.352830:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96b366b18400:6512] 0 exiting: rc = 1 00000100:00100000:0.0:1787599505.353226:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff96b35158b000:6515] 2 exiting: rc = 0 00000100:00100000:1.0:1787599505.353418:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353426:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353432:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353438:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353445:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353452:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353459:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353465:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353470:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353476:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353488:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353494:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353503:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353508:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353518:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353524:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353530:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353535:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353542:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353549:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353554:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353570:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353576:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353582:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353592:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353598:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353608:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353617:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353623:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353632:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353638:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353646:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353653:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353661:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353667:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353676:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353682:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353690:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353696:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353704:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353710:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353719:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353726:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353732:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353740:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353746:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353753:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353760:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353768:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353774:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353779:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353784:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353819:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353824:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353830:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353835:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353848:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353854:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353864:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353870:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353879:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353885:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353893:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599505.353900:0:15109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787599505.356914:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242f2b660 - data ffff96b241c380d8/ffff96b242328800 00000020:01000000:1.0:1787599505.357066:0:15109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b370568c00 - data ffff96b366023438/ffff96b351f05400 00000020:00000080:1.0:1787599505.357501:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cedd5 00000020:00000080:1.0:1787599505.357510:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b378282000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787599505.357531:0:15109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3707b1000 from MGS, refs=2 00000020:01000004:1.0:1787599505.357534:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3707b1000 2 00000020:01000004:1.0:1787599505.357538:0:15109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b3707b1000 from MGS 00000020:00000080:1.0:1787599505.357559:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.357565:0:15109:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787599505.357567:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b378284000/MGS 00000020:00000080:1.0:1787599505.357570:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378284000/MGS for MGS 00000020:01000000:1.0:1787599505.357577:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787599505.357647:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787599505.357651:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599505.357657:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599505.357663:0:15109:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96b3434d6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599505.357668:0:15109:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff96b37077b370) has exports, disconnecting them 00000020:00080000:1.0:1787599505.357672:0:15109:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96b3434d6000), last request at 1787599247 00000020:00000080:1.0:1787599505.357676:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929ceea0 00000020:00080000:1.0:1787599505.357685:0:15109:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b3434d6000): rc 0 00000020:00000080:1.0:1787599505.357689:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434d6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787599505.358341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378282000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787599505.358351:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:3.0:1787599505.449971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578010368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599505.450059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450131:0:10101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010368 00000100:00100000:3.0:1787599505.450139:0:10101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010368 00000100:00100000:3.0:1787599505.450189:0:10101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787599505.450199:0:10101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578010368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599505.450230:0:10101:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787599505.450271:0:10101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578010368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599505.450278:0:10101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787599505.450297:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599505.450344:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578010368:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787599505.450438:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599505.450442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599505.450445:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599505.450450:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787599505.450466:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599505.450471:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b378218000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599505.450490:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b351769880 x1874433578010624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599505.450507:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599505.450511:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599505.450512:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599505.450515:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787599505.450518:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599505.450521:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b381b74000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599505.450535:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2419c3480 x1874433578010752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599505.450543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599505.450546:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599505.450548:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599505.450551:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787599505.450553:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599505.450556:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b2419da000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599505.450566:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2419c1500 x1874433578010880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599505.450591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599505.450594:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599505.450596:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599505.450599:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787599505.450608:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599505.450612:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b2430b8800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599505.450624:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2419c1f80 x1874433578011136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599505.450720:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578010624:0@lo:38:kworker.0 00000100:00100000:3.0:1787599505.450750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450772:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578010752:0@lo:38:kworker.0 00000100:00100000:3.0:1787599505.450835:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450854:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578010880:0@lo:38:kworker.0 00000100:00100000:3.0:1787599505.450875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450890:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578011136:0@lo:38:kworker.0 00000100:00100000:3.0:1787599505.450909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450938:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578011264:0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.450962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.450980:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599505.450985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578011008:0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.451032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010624 00000100:00100000:3.0:1787599505.451037:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010624 00000100:00100000:3.0:1787599505.451060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787599505.451066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578010624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787599505.451083:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599505.451118:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578010624:12345-0@lo:38:kworker.0 Request processed in 50us (366us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599505.451125:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787599505.451151:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010752 00000100:00100000:3.0:1787599505.451155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010752 00000100:00100000:3.0:1787599505.451167:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578010880 00000100:00100000:3.0:1787599505.451169:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578010880 00000100:00100000:3.0:1787599505.451176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011136 00000100:00100000:3.0:1787599505.451178:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011136 00000100:00100000:3.0:1787599505.451185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011264 00000100:00100000:3.0:1787599505.451187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011264 00000100:00100000:3.0:1787599505.451207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011008 00000100:00100000:3.0:1787599505.451210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011008 00000100:00100000:3.0:1787599505.451223:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787599505.451229:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578011264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451267:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578011264:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599505.451273:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787599505.451284:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787599505.451290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578011008:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599505.451320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787599505.451331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787599505.451334:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578010752:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787599505.451344:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599505.451365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578010752:12345-0@lo:38:kworker.0 Request processed in 29us (530us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599505.451371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787599505.451381:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787599505.451384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578010880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787599505.451400:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599505.451422:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578010880:12345-0@lo:38:kworker.0 Request processed in 36us (546us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599505.451427:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787599505.451438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787599505.451442:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578011136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787599505.451450:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599505.451473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578011136:12345-0@lo:38:kworker.0 Request processed in 29us (563us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599505.451479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787599505.451512:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578010496:0@lo:400:kworker.0 00000400:00000100:3.0:1787599505.451531:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578010496 offset 0 length 224: 4 00000100:00100000:3.0:1787599505.451552:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599505.451557:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578011392:0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599505.451607:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011392 00000100:00100000:3.0:1787599505.451611:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011392 00000100:00100000:3.0:1787599505.451640:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599505.451646:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578011392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451677:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578011392:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599505.451683:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787599505.451700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599505.451703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787599505.451721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c2a00 x1874433578011008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599505.451739:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578011008:0@lo:400:kworker.0 00010000:00080000:3.0:1787599505.451752:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2419c3800 x1874433578011264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599505.451760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578011264:0@lo:400:kworker.0 00000100:00100000:3.0:1787599505.451818:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578011392:0@lo:400:kworker.0 00000100:00080000:3.0:1787599505.451842:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599505.451847:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599505.451850:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578010624:0@lo:38:kworker.0 00000100:00080000:3.0:1787599505.451858:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599505.451861:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599505.451864:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578010752:0@lo:38:kworker.0 00000100:00080000:3.0:1787599505.451871:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599505.451874:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599505.451878:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578010880:0@lo:38:kworker.0 00000100:00080000:3.0:1787599505.451885:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599505.451888:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599505.451892:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578011136:0@lo:38:kworker.0 00010000:01000000:3.0:1787599505.592884:0:15109:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787599505.592892:0:15109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599505.592896:0:15109:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787599505.592903:0:15109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787599505.592935:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787599505.593146:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599505.593155:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787599505.593161:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3434d2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787599505.593165:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787599505.593177:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787599505.593266:0:15109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3707b1000 1 00000020:00000080:3.0:1787599505.593272:0:15109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cedc7 00000020:00000080:3.0:1787599505.593278:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b378283800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787599505.593286:0:15109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787599505.593294:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378283800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787599505.593303:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599505.593308:0:15109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787599505.593312:0:15109:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff96b370778000) has no exports 00010000:00010000:3.0:1787599505.662502:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787599505.770720:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599505.770733:0:15109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787599505.770739:0:15109:0:(genops.c:885:class_export_put()) final put ffff96b3707b5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787599505.770755:0:15109:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3707b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787599505.770761:0:15109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787599505.770928:0:15109:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b3707b0000 00000020:02000400:1.0:1787599505.774244:0:15109:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1787599505.957676:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599505.957699:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578011520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599505.957762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599505.957850:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011520 00000100:00100000:1.0:1787599505.957859:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011520 00000100:00100000:1.0:1787599505.957904:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787599505.957913:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578011520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599505.959031:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787599505.959102:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578011520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1189us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599505.959111:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787599505.960296:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578011520:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787599506.665725:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599507.685051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599508.712851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787599509.394467:0:15310:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787599509.410159:0:15310:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787599509.410218:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.410232:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.410240:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.410246:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.411437:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787599509.411450:0:15310:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787599509.411484:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599509.411488:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787599509.411495:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787599509.411501:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b381b74000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787599509.411521:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599509.411523:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787599509.411525:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787599509.413149:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.413167:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.413174:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.413181:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413263:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599509.413409:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413418:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599509.413423:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413432:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599509.413439:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599509.413457:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599509.413460:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787599509.413463:0:10398:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787599509.413498:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413504:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599509.413549:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413557:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497e00/0x5d2988b0929cf331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf338 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413572:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599509.413576:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413581:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599509.413583:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413589:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599509.413595:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599509.413820:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599509.413822:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787599509.413840:0:10398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413851:0:10398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599509.413860:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.413866:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599509.413868:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599509.413870:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599509.413887:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578011648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599509.414073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599509.414332:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599509.414339:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578011776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599509.414364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599509.414611:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599509.414619:0:15310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6c00/0x5d2988b0929cf33f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf346 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415837:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415852:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415858:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415865:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415903:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599509.415971:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599509.415977:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415985:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599509.415988:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.415996:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599509.416003:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599509.416009:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599509.416012:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787599509.416015:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787599509.416049:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416055:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599509.416079:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416085:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381324200/0x5d2988b0929cf20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416100:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599509.416107:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599509.416109:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599509.416122:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599509.416136:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578011904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599509.416189:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416197:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416203:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416210:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416223:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599509.416228:0:15310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416234:0:15310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416240:0:15310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416245:0:15310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416253:0:15310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787599509.416262:0:15310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787599509.416265:0:15310:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787599509.416457:0:15310:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787599509.416461:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787599509.416466:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599509.416471:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787599509.416476:0:15310:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff96b2430bf800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599509.416482:0:15310:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff96b37bb4e800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599509.416487:0:15310:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff96b3810d8000) has exports, disconnecting them 00000020:00080000:0.0:1787599509.416492:0:15310:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96b2430bf800), last request at 1787599505 00000020:00000080:0.0:1787599509.416499:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf1d3 00000100:00080000:0.0:1787599509.416513:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787599509.416544:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599509.416548:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416555:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381325200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599509.416558:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416565:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599509.416571:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599509.416577:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787599509.416579:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787599509.416581:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787599509.416654:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416668:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599509.416681:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416688:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381325200/0x5d2988b0929cf599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929cf5a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416697:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599509.416700:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416705:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599509.416708:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416714:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599509.416720:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599509.416726:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599509.416728:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787599509.416730:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787599509.416743:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416748:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599509.416768:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416783:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497400/0x5d2988b0929ceef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929ceefb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.416813:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599509.416816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599509.416817:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787599509.416834:0:15310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b2430bf800): rc 0 00000020:00000080:0.0:1787599509.416837:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b2430bf800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787599509.416849:0:15310:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96b37bb4e800), last request at 1787599505 00000020:00000080:0.0:1787599509.416854:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf0ad 00000100:00080000:0.0:1787599509.416859:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b37bb48800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787599509.416870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787599509.416876:0:15310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b37bb4e800): rc 0 00000020:00000080:0.0:1787599509.416878:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b37bb4e800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787599509.416884:0:15310:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb1441c83ae0 00000100:00080000:0.0:1787599509.416900:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599509.416903:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1787599509.417017:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599509.419421:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787599509.419431:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b378218000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1787599509.419666:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578012160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599509.419733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599509.419958:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599509.419964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599509.419971:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599509.419981:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578012032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599509.420354:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011648 00000100:00100000:2.0:1787599509.420363:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011648 00000100:00100000:2.0:1787599509.420401:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011776 00000100:00100000:2.0:1787599509.420405:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011776 00000100:00100000:2.0:1787599509.420423:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599509.420431:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1874433578011648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599509.420438:0:15023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599509 with bad export cookie 6713047011527814641 00000020:00000080:3.0:1787599509.422813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430bf800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787599509.422882:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37bb4e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787599509.422905:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2430b8000 for lustre-MDT0001 00000020:00000080:3.0:1787599509.422909:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37bb48800 for lustre-MDT0001 00000100:00100000:1.0:1787599509.426819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599509.426856:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578012160 00000100:00100000:1.0:1787599509.426865:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578012160 00000100:00100000:1.0:1787599509.426900:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578011904 00000100:00100000:1.0:1787599509.426902:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578011904 00000100:00100000:3.0:1787599509.427074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599509.427127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599509.427137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1874433578011776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787599509.427145:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599509 with bad export cookie 6713047011527814641 00000100:00100000:1.0:1787599509.427221:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1874433578011776:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (12855us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787599509.427229:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599509.427246:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578012032 00000100:00100000:1.0:1787599509.427250:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578012032 00000100:00080000:3.0:1787599509.427365:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787599509.427370:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b353223800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787599509.427374:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787599509.427415:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787599509.427420:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1874433578012160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787599509.427425:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599509 with bad export cookie 6713047011527814641 00000100:00100000:1.0:1787599509.427452:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1874433578012160:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (7720us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787599509.427459:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787599509.427471:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599509.427475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b345ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1874433578011904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787599509.427479:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599509 with bad export cookie 6713047011527814641 00000100:00100000:1.0:1787599509.427509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b345ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1874433578011904:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (720us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787599509.427514:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599509.427526:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599509.427530:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1874433578012032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787599509.427534:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599509 with bad export cookie 6713047011527814641 00000100:00100000:1.0:1787599509.427561:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1874433578012032:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (487us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787599509.427567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787599509.427589:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787599509.430147:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599509.430156:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1787599509.430183:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787599509.430251:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787599509.430308:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b377b88800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787599509.430334:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599509.430336:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787599509.430347:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787599509.430402:0:15310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787599509.430411:0:15310:0:(import.c:65:import_set_state_nolock()) ffff96b243466800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787599509.430436:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96b3810d8000) has no exports 00000100:00080000:0.0:1787599509.430698:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1787599509.431420:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1874433578011648:12345-0@lo:103:ldlm_bl.0 Request processed in 10985us (17343us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599509.431431:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599509.437483:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578012288:0@lo:9:umount.0 00000100:00100000:2.0:1787599509.437565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599509.437620:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578012416:0@lo:9:umount.0 00000100:00100000:2.0:1787599509.437643:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599509.437705:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578012288 00000100:00100000:2.0:1787599509.437712:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578012288 00000100:00100000:2.0:1787599509.437781:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578012416 00000100:00100000:2.0:1787599509.437785:0:8629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578012416 00000100:00100000:2.0:1787599509.437824:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787599509.437835:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874433578012288:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787599509.437864:0:8629:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf0fa 00000100:00080000:2.0:1787599509.437873:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b37bb4b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599509.437913:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787599509.439229:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1874433578012288:12345-0@lo:9:umount.0 Request processed in 1395us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599509.439239:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787599509.439259:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599509.439342:0:8629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874433578012416:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787599509.439361:0:8629:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf23c 00000100:00080000:2.0:1787599509.439369:0:8629:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599509.439401:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787599509.439480:0:8629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1874433578012416:12345-0@lo:9:umount.0 Request processed in 213us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599509.439486:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787599509.439526:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599509.439531:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599509.439546:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599509.439551:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599509.439581:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b377b88800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787599509.439595:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787599509.439813:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599509.439819:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578012288:0@lo:9:umount.0 00000100:00080000:2.0:1787599509.439836:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b243466800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787599509.439845:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787599509.439847:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599509.439849:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578012416:0@lo:9:umount.0 00000100:00080000:3.0:1787599509.461450:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787599509.461457:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787599509.461467:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b351768700 x1874433578010496/t0(0) o400->MGC192.168.202.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787599521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599509.461483:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2443e5c00 x1874433578011648/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599509.461517:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2443e4380 x1874433578011776/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599509.461525:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ea00 x1874433578011904/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599509.461534:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138d880 x1874433578012160/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599509.461543:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138c000 x1874433578012032/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787599509.461551:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787599509.461555:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787599509.461557:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787599509.461732:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96b353223800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787599509.462370:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578010496:0@lo:400:kworker.0 00000100:00100000:1.0:1787599509.462401:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3648:1874433578011904:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787599509.462589:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96b353223800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787599509.463551:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3647:1874433578012032:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787599509.464414:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b353223800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599509.464424:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:3.0:1787599509.464432:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b353223800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599509.464579:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b370013480 x1874433578012544/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599509.464696:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433578012544:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787599509.464763:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578012544 offset 0 length 520: 4 00000100:00100000:2.0:1787599509.465166:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578011648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599509.465188:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578012160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599509.465192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3645:1874433578011776:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787599509.474084:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96b3810d8000) has no exports 00000020:01000000:2.0:1787599509.555138:0:15310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242ffbd80 - data ffff96b36633e510/ffff96b379d68000 00000020:01000000:2.0:1787599509.555316:0:15310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b358d98000 - data ffff96b3661761b0/ffff96b3813dd800 00000001:00000004:2.0:1787599509.566200:0:15310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1787599509.634474:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599509.634486:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787599509.634496:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787599509.653858:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787599509.653884:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1787599509.653902:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599509.653904:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787599509.655241:0:8623:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787599509.655248:0:8623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787599509.655262:0:8623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787599509.655858:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787599509.655862:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787599509.655876:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599509.655879:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787599509.656391:0:9983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787599509.656395:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787599509.656415:0:9983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787599509.657540:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef17 00000020:00000080:1.0:1787599509.657550:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b350f2e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787599509.658297:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b350f2e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787599509.659435:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef2c 00000020:00000080:1.0:1787599509.659447:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b376564000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787599509.659496:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787599509.659501:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599509.659508:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599509.659512:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff96b3810d99b8) has no exports 00000004:01000000:1.0:1787599509.659673:0:15310:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787599509.659680:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf235 00000020:00000080:1.0:1787599509.659684:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b377b3c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.662978:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b376564000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787599509.666553:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787599509.666571:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599509.666587:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787599509.666594:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff96b37077cd28) has no exports 00000020:00000080:1.0:1787599509.666603:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf22e 00000020:00000080:1.0:1787599509.666612:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b243465800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787599509.670301:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b3c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1787599509.674579:0:15310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787599509.674587:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787599509.674592:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787599509.674598:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599509.674601:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787599509.677422:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b243465800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787599509.680179:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.680200:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599509.680211:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf0f3 00000020:00000080:1.0:1787599509.680231:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b377b8c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.681658:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b243466800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787599509.681675:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b377b3f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.681678:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b3f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787599509.681698:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787599509.683531:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787599509.683544:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599509.683557:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787599509.683562:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff96b3706f19b8) has no exports 00000020:00000080:1.0:1787599509.683571:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf0ec 00000020:00000080:1.0:1787599509.683579:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b377b8e800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787599509.683857:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b8c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787599509.683865:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b8e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787599509.684342:0:15310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787599509.684346:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787599509.684350:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1787599509.684356:0:15310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599509.684358:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599509.684436:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.684445:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787599509.684468:0:15310:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787599509.684475:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef4f 00000020:00000080:1.0:1787599509.684481:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b381b28800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.685629:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b377b88800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787599509.685644:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b2419cb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.685647:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419cb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787599509.685653:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787599509.685939:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787599509.686057:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599509.686067:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599509.686072:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff96b345e099b8) has no exports 00000020:00000080:0.0:1787599509.686080:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef48 00000020:00000080:0.0:1787599509.686087:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b37821f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787599509.688471:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381b28800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787599509.691411:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37821f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787599509.691846:0:15310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787599509.691852:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599509.691856:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787599509.691862:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599509.691907:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.691927:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599509.691956:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.691960:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599509.691965:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b37821e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599509.691969:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37821e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787599509.691979:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599509.692166:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef33 00000020:00000080:1.0:1787599509.692174:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b376562800/lustre-MDD0001_UUID 00000020:01000000:1.0:1787599509.692189:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787599509.692193:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599509.692198:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599509.692202:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff96b3810db370) has no exports 00000020:00000080:1.0:1787599509.692224:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.692228:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787599509.692232:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef3a 00000020:00000080:1.0:1787599509.692236:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b376564800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787599509.692244:0:15310:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3812cf000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787599509.692247:0:15310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3812cf000 2 00000020:01000004:1.0:1787599509.692250:0:15310:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b3812cf000 from lustre-MDT0001 00000020:00000080:1.0:1787599509.692266:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599509.692269:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787599509.692272:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b378219000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787599509.692273:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378219000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787599509.692283:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787599509.692311:0:15310:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787599509.692315:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787599509.692317:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599509.692320:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599509.692327:0:15310:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff96b381b76000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599509.692332:0:15310:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff96b3707b99b8) has exports, disconnecting them 00000020:00080000:1.0:1787599509.692336:0:15310:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff96b381b76000), last request at 1787599266 00000020:00000080:1.0:1787599509.692339:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cef8e 00000020:00080000:1.0:1787599509.692352:0:15310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b381b76000): rc 0 00000020:00000080:1.0:1787599509.692356:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b381b76000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787599509.693236:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b378218000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787599509.693247:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b3819f2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599509.693249:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3819f2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787599509.693254:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787599509.693360:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b376562800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787599509.693365:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b3810cf000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787599509.693367:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3810cf000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787599509.693370:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787599509.693536:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b376564800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787599509.693541:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381b76000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787599509.693845:0:15310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787599509.693850:0:15310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599509.693854:0:15310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787599509.693859:0:15310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787599509.693880:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b381b74000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787599509.694029:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599509.694036:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787599509.694039:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b346c1c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787599509.694051:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff96b346c1c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787599509.694054:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787599509.694085:0:15310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3812cf000 1 00000020:00000080:3.0:1787599509.694089:0:15310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929ceeca 00000020:00000080:3.0:1787599509.694094:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b38112a000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787599509.694101:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787599509.694108:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b38112a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787599509.694116:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599509.694130:0:15310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787599509.694134:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff96b345e0cd28) has no exports 00010000:00010000:0.0:1787599509.745906:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599509.806223:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599509.806236:0:15310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787599509.806241:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b3812cd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787599509.806245:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3812cd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787599509.806251:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787599509.806364:0:15310:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b3812cd800 00000020:01000000:3.0:1787599509.806386:0:15310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787599509.806389:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599509.806392:0:15310:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787599509.806396:0:15310:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff96b345e0b370) has no exports 00000100:00100000:3.0:1787599509.806481:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96b34de2b200:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1787599509.806589:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96b359315200:6522] 2 exiting: rc = 0 00000100:00100000:3.0:1787599509.806671:0:10099:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96b24334f200:10099] 3 exiting: rc = 0 00000100:00100000:3.0:1787599509.806737:0:13004:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff96b377afa600:13004] 4 exiting: rc = 0 00000100:00100000:1.0:1787599509.812658:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff96b349b62000:6520] 0 exiting: rc = 1 00000100:00100000:2.0:1787599509.813421:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813434:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813441:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813446:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813452:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813458:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813464:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813470:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813487:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813493:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813499:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813505:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813511:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813517:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813523:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813528:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813534:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813540:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813545:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813550:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813555:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813561:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813566:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813570:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813577:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813599:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813607:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813613:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813619:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813625:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813631:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813636:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813642:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813647:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813653:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813659:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813665:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813670:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813676:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813682:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813688:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813694:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813700:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813713:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813719:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813725:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813731:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813736:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813741:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813757:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813764:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813770:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813775:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813780:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813786:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813816:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813824:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813831:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813836:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813842:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813848:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813854:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813860:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.813866:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599509.822116:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96b359359a00:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787599509.827105:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96b359358000:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1787599509.827357:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827367:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827373:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827381:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827400:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827407:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827413:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827419:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827424:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827430:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827435:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827441:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827448:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827453:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827459:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827464:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827469:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827475:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827480:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827486:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827491:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827496:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827502:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827508:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827513:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827518:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827524:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827529:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827535:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827540:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827546:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827551:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827556:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827562:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827568:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827573:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827578:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827583:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827588:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827599:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827604:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827609:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827614:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827620:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827625:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827631:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827636:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827640:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827645:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827651:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827655:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827660:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827665:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827671:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827676:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827682:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827687:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827693:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827699:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827704:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827708:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827713:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827718:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.827724:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.828582:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96b370565a00:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1787599509.828685:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96b34de2a400:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1787599509.830299:0:7828:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff96b3505a9200:7828] 2 exiting: rc = 0 00000100:00100000:2.0:1787599509.830447:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830474:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830482:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830489:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830495:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830501:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830508:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830523:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830530:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830536:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830543:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830563:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830569:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830575:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830583:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830588:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830595:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830601:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830607:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830627:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830636:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830642:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830648:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830654:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830662:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830668:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830674:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830680:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830685:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830692:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830698:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830718:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830725:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830731:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830736:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830742:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830767:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830774:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830779:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830785:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830817:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830825:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830831:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830850:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830858:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830865:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830878:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830883:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830889:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830894:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830900:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.830908:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831192:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831200:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831207:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831227:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831235:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831241:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831247:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831253:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831259:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831266:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831272:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.831286:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599509.861216:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96b352bd5c00:6528] 1 exiting: rc = 0 00000100:00100000:2.0:1787599509.864927:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96b352bd4000:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1787599509.865110:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866018:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866036:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866042:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866046:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866052:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866056:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866061:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866067:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866088:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866093:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866098:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866103:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866107:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866112:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866116:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866192:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866199:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866207:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866213:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866219:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866225:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866231:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866235:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866240:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866245:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866250:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866254:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866258:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866262:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866267:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866272:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866277:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866281:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866286:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866291:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866296:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866301:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866306:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866311:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866317:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866322:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866327:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866332:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866345:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866350:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866355:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866359:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866364:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866368:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866374:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866378:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866383:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866389:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866394:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866399:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866405:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866409:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866415:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866420:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866425:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866431:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866437:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.866442:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599509.868082:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff96b34ec28a00:6529] 0 exiting: rc = 1 00000100:00100000:3.0:1787599509.871445:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff96b35137e600:6530] 1 exiting: rc = 0 00000100:00100000:1.0:1787599509.871608:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871616:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871623:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871628:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871634:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871639:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871644:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871650:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871656:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871981:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871988:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871993:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.871997:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872002:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872008:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872013:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872018:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872023:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872028:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872033:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872039:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872043:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872049:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872054:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872059:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872065:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872070:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872075:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872081:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872085:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872090:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872094:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872099:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872103:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872108:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872112:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872117:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872121:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872126:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872132:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872137:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872142:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872147:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872152:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872165:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872170:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872176:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872180:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872185:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872190:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872195:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872200:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872205:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872211:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872216:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872221:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872227:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872232:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872237:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872243:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872248:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872253:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872258:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.872263:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599509.872988:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff96b34ec20000:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1787599509.873212:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff96b35137f600:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1787599509.873258:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873332:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873341:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873346:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873351:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873356:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873361:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873370:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873489:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873495:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873501:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873507:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873512:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873589:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873597:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873611:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873616:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873622:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873627:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873632:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873637:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873643:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873647:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873651:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873656:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873661:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873666:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873859:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873868:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873873:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873878:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873883:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873888:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873893:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873899:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873904:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873909:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873915:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873920:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873925:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873931:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873937:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873942:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873947:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873951:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873956:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873961:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873966:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873971:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873976:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873989:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873994:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.873998:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874003:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874008:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874014:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874020:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874025:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874030:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874036:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874040:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874046:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874051:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.874056:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599509.877443:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff96b34ec20a00:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1787599509.877666:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff96b370685200:6535] 2 exiting: rc = 0 00000100:00100000:0.0:1787599509.878392:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff96b37069bc00:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1787599509.879168:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879177:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879204:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879210:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879215:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879221:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879226:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879232:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879238:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879244:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879249:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879255:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879273:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879281:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879286:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879291:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879297:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879302:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879308:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879313:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879318:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879334:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879340:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879345:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879351:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879357:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879375:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879383:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879389:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879394:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879399:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879407:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879412:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879419:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879424:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879431:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879436:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879441:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879447:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879452:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879457:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879463:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879469:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879476:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879481:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879488:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879493:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879499:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879504:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879509:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879647:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879655:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879661:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879667:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879936:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879942:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879956:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879961:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879967:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.879996:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.880002:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.880008:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.880013:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599509.880019:0:15310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787599509.886042:0:15310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599509.886055:0:15310:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787599509.886061:0:15310:0:(genops.c:885:class_export_put()) final put ffff96b34dd63000/MDS_uuid 00000020:00000080:2.0:1787599509.886066:0:15310:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34dd63000/MDS_uuid for MDS 00000020:01000000:2.0:1787599509.886078:0:15310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787599509.886226:0:15310:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1787599510.565069:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599510.565081:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599510.565085:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599510.565090:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787599510.565093:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599510.565102:0:13886:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1787599510.565107:0:13886:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787599510.565115:0:13886:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b2419da000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599510.565158:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138df80 x1874433578012672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599510.565244:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578012672:0@lo:38:kworker.0 00000400:00000100:2.0:1787599510.565299:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578012672 offset 0 length 520: 4 00000100:00080000:0.0:1787599510.565414:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599510.565417:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787599510.565420:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599510.565424:0:13886:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1787599510.565426:0:13886:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787599510.565430:0:13886:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b2430b8800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599510.565441:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138d180 x1874433578012928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599510.565492:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599510.565506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578012800:0@lo:400:kworker.0 00000400:00000100:1.0:1787599510.565531:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578012800 offset 0 length 224: 4 00000100:00100000:2.0:1787599510.566530:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578012928:0@lo:38:kworker.0 00000400:00000100:2.0:1787599510.566648:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578012928 offset 0 length 520: 4 00000100:00100000:3.0:1787599510.567107:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578013056:0@lo:400:kworker.0 00000400:00000100:3.0:1787599510.567133:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013056 offset 0 length 224: 4 00010000:00010000:1.0:1787599510.758788:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599511.783084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599512.805092:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787599513.692589:0:15511:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787599513.708688:0:15511:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787599513.708767:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599513.708784:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599513.708822:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599513.708830:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599513.708848:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787599513.708854:0:15511:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787599513.708865:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599513.708872:0:10398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599513.708880:0:10398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc114bc20) 00000100:00080000:1.0:1787599513.708883:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:0.0:1787599513.708883:0:10398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599513.708891:0:10398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599513.708894:0:15511:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138df80 x1874433578012672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1787599513.708899:0:10398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599513.708905:0:10398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599513.708908:0:10398:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:1.0:1787599513.708910:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:01000000:0.0:1787599513.708910:0:10398:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787599513.708922:0:10398:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:0.0:1787599513.708925:0:10398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599513.708928:0:15511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787599513.708933:0:15511:0:(import.c:65:import_set_state_nolock()) ffff96b2419da000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787599513.708936:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7000/0x5d2988b0929cf315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf31c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599513.708938:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599513.708942:0:15511:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138df80 x1874433578012672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787599513.708946:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599513.708948:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599513.708949:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:0.0:1787599513.708950:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599513.708952:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1787599513.709019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578012672:0@lo:38:kworker.0 00000100:00080000:1.0:1787599513.710558:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599513.710572:0:15511:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ca80 x1874433578012800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599513.710597:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787599513.710603:0:15511:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787599513.710627:0:15511:0:(import.c:65:import_set_state_nolock()) ffff96b3819f1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787599513.710755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578013184:0@lo:39:umount.0 00000400:00000100:0.0:1787599513.710838:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013184 offset 0 length 224: 4 00000100:00100000:2.0:1787599513.710977:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578012800:0@lo:400:kworker.0 00010000:00010000:1.0:1787599513.829135:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599514.596994:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599514.597007:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599514.597011:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599514.597014:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787599514.597167:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578013312:0@lo:400:kworker.0 00000400:00000100:2.0:1787599514.597310:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013312 offset 0 length 224: 4 00010000:00010000:2.0:1787599514.855597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599515.180085:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599515.180094:0:8429:0:(genops.c:885:class_export_put()) final put ffff96b37bb4d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787599515.180382:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787599515.180386:0:9515:0:(genops.c:885:class_export_put()) final put ffff96b2430bc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787599515.180549:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37bb4d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787599515.180606:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430bc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787599515.180625:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37bb4b000 for lustre-OST0000 00000020:00000080:0.0:1787599515.180631:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2430b9000 for lustre-OST0001 00000100:00080000:1.0:1787599515.621815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787599515.621828:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599515.621831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787599515.621834:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599515.621963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599515.621987:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578013440:0@lo:400:kworker.0 00000400:00000100:3.0:1787599515.622053:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013440 offset 0 length 224: 4 00010000:00010000:3.0:1787599515.876966:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599516.901057:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599517.925870:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599518.950131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599519.851010:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599509/real 1787599509] req@ffff96b370013480 x1874433578012544/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599519 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599519.851047:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b370013480 x1874433578012544/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599519 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599519.851068:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b353223800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599519.851151:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787599519.851155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433578012544:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787599519.851231:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599519.851237:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787599519.851239:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b353223800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599519.851245:0:13886:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1787599519.851249:0:13886:0:(import.c:589:import_select_connection()) MGC192.168.202.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787599519.851256:0:13886:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b353223800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599519.851291:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138f480 x1874433578013568/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599519.851331:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599519.851335:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599519.851700:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578013696:0@lo:400:kworker.0 00000400:00000100:3.0:1787599519.851885:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013696 offset 0 length 224: 4 00000100:00100000:2.0:1787599519.852021:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433578013568:0@lo:250:kworker.0 00000400:00000100:2.0:1787599519.852044:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578013568 offset 0 length 520: 4 00010000:00010000:3.0:1787599519.974649:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599520.998507:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599522.021833:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599523.045176:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599523.941244:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599513/real 1787599513] req@ffff96b2443e4a80 x1874433578013184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599523 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599523.941282:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2443e4a80 x1874433578013184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599523 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599523.941303:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3819f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787599523.941329:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578013184:0@lo:39:umount.0 00000100:00080000:1.0:1787599523.942282:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599523.942287:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787599523.942293:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787599523.943238:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943265:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943272:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943278:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943305:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599523.943314:0:15511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943320:0:15511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943327:0:15511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943335:0:15511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599523.943698:0:15511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787599523.943705:0:15511:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787599523.943736:0:15511:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787599523.943740:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787599523.943746:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599523.943752:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599523.943757:0:15511:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96b3706f4d28) has no exports 00000020:00080000:1.0:1787599523.943785:0:15511:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96b3706f4d28) has no exports 00010000:00010000:3.0:1787599523.946715:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599523.946729:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946741:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b341497a00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599523.946745:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946756:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599523.946764:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599523.946770:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599523.946773:0:10397:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787599523.946777:0:10397:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787599523.946810:0:10397:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:3.0:1787599523.946830:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946838:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341497a00/0x5d2988b0929cf323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf32a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946955:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599523.946961:0:10397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946968:0:10397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b381324c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:3.0:1787599523.946971:0:10397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.946979:0:10397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599523.946986:0:10397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599523.946991:0:10397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787599523.946993:0:10397:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787599523.946995:0:10397:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787599523.947002:0:10397:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:3.0:1787599523.947006:0:10397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.947012:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b381324c00/0x5d2988b0929cf58b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599523.947021:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599523.947029:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599523.947031:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787599523.948164:0:15511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b2430844e0 - data ffff96b3662b2798/ffff96b242355800 00000020:01000000:1.0:1787599523.948438:0:15511:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b358d984e0 - data ffff96b3662b31b0/ffff96b37f835400 00010000:00010000:0.0:1787599523.948581:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787599523.959663:0:15511:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787599523.971461:0:15511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf067 00000020:00000080:0.0:1787599523.971477:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b2419cf000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787599523.971643:0:15511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3778e6800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787599523.971648:0:15511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3778e6800 2 00000020:01000004:0.0:1787599523.971651:0:15511:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b3778e6800 from lustre-OST0000 00000020:00000080:0.0:1787599523.971686:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599523.971701:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787599523.971704:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b2419cd800/lustre-OST0000_UUID 00000020:00000080:0.0:1787599523.971707:0:15511:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419cd800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787599523.971715:0:15511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787599523.972003:0:15511:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787599523.972008:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787599523.972011:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599523.972017:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787599523.972023:0:15511:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96b346c1a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599523.972029:0:15511:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff96b3707bb370) has exports, disconnecting them 00000020:00080000:0.0:1787599523.972034:0:15511:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96b346c1a800), last request at 1787599286 00000020:00000080:0.0:1787599523.972038:0:15511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf091 00000020:00080000:0.0:1787599523.972049:0:15511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b346c1a800): rc 0 00000020:00000080:0.0:1787599523.972053:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b346c1a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787599523.972632:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419cf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787599523.973392:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b346c1a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787599523.979777:0:15511:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787599523.979785:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599523.979948:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599523.979956:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599523.980145:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599523.980154:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787599523.980161:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787599523.980166:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599523.980170:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787599523.980181:0:15511:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff96b37821a800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599523.980189:0:15511:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff96b345e08000) has exports, disconnecting them 00000020:00080000:2.0:1787599523.980196:0:15511:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff96b37821a800), last request at 1787599286 00000020:00000080:2.0:1787599523.980201:0:15511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf0a6 00000020:00080000:2.0:1787599523.980216:0:15511:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b37821a800): rc 0 00000020:00000080:2.0:1787599523.980220:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b37821a800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787599523.980249:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2419da000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787599523.980256:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b2419df000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787599523.980258:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2419df000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787599523.980267:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787599523.980478:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37821a800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787599523.981980:0:15511:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787599523.981986:0:15511:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787599523.981989:0:15511:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599523.981996:0:15511:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599523.982229:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599523.982236:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787599523.982242:0:15511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3778e6800 1 00000020:00000080:2.0:1787599523.982247:0:15511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf02f 00000020:00000080:2.0:1787599523.982254:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b377a85000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787599523.982258:0:15511:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787599523.982262:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599523.982265:0:15511:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787599523.982277:0:15511:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff96b3707b8000) has no exports 00000020:00000080:2.0:1787599523.992074:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3819f1800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787599523.992088:0:36:0:(genops.c:885:class_export_put()) final put ffff96b346c1c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787599523.992096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b346c1c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787599523.992103:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787599523.993156:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377a85000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787599524.042518:0:15511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599524.042533:0:15511:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787599524.042539:0:15511:0:(genops.c:885:class_export_put()) final put ffff96b3778e0000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787599524.042543:0:15511:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3778e0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787599524.042557:0:15511:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787599524.042687:0:15511:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b3778e2000 00000020:02000400:2.0:1787599524.042749:0:15511:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787599524.071032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599524.904124:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599524.904135:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599524.904155:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787599524.904159:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599524.904376:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578013824:0@lo:400:kworker.0 00000400:00000100:1.0:1787599524.904435:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013824 offset 0 length 224: 4 00010000:00010000:2.0:1787599525.094938:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599526.126703:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787599526.949204:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599510/real 1787599510] req@ffff96b2443e4000 x1874433578013056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599526 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.005273:0:3647:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff96b2443e4000 x1874433578013056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599526 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599527.005290:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787599527.005294:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787599527.019010:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787599527.019329:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599527.019334:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599527.019337:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599527.019340:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599527.019343:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599527.019346:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787599527.019351:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599527.019358:0:13886:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 259 00000100:00080000:3.0:1787599527.019368:0:13886:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96b2430b9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599527.019410:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405c700 x1874433578013952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599527.019513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578013952:0@lo:38:kworker.0 00000400:00000100:0.0:1787599527.019568:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578013952 offset 0 length 520: 4 00000100:00100000:0.0:1787599527.019641:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578013056:0@lo:400:kworker.0 00010000:00010000:1.0:1787599527.150355:0:10398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599527.486864:0:15713:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787599527.510575:0:15713:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787599527.510677:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.510692:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.510700:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.510707:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.510745:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787599527.510750:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787599527.510773:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599527.510783:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138d180 x1874433578012928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.510836:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787599527.510842:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787599527.510849:0:15713:0:(import.c:65:import_set_state_nolock()) ffff96b2430b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787599527.510854:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599527.510859:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138d180 x1874433578012928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.510868:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787599527.510871:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1787599527.510892:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578012928:0@lo:38:kworker.0 00010000:00010000:0.0:1787599527.510986:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599527.510993:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.511001:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599527.511006:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.511015:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599527.511023:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599527.511029:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599527.511031:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787599527.511034:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787599527.511047:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:0.0:1787599527.511051:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.511058:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7800/0x5d2988b0929cf2f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf300 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.511077:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599527.511079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599527.511081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599527.511967:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599527.511977:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ce00 x1874433578013312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512045:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2443e7100 x1874433578013440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599531 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512064:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ca80 x1874433578013696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512072:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138df80 x1874433578013824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512090:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b24405c700 x1874433578013952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599537 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512102:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787599527.512107:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787599527.512121:0:15713:0:(import.c:65:import_set_state_nolock()) ffff96b2430b9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787599527.512127:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599527.512140:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ce00 x1874433578013312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599527.512163:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578013824:0@lo:400:kworker.0 00000100:00100000:3.0:1787599527.512199:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578013696:0@lo:400:kworker.0 00000100:00100000:2.0:1787599527.512304:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578013312:0@lo:400:kworker.0 00000100:00100000:1.0:1787599527.512364:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2443e7100 x1874433578013440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599531 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512370:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138ca80 x1874433578013696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599535 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512375:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138df80 x1874433578013824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599540 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512380:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b24405c700 x1874433578013952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599537 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599527.512383:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787599527.512999:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578013440:0@lo:400:kworker.0 00000100:00100000:3.0:1787599527.513036:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578013952:0@lo:38:kworker.0 00000100:00100000:1.0:1787599527.513190:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787599527.514246:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514259:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514266:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514271:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514396:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599527.514405:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514422:0:15713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514428:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599527.514433:0:15713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514484:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599527.514492:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514500:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6a00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599527.514504:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514512:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599527.514517:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599527.514529:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787599527.514531:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787599527.514540:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:2.0:1787599527.514543:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514547:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6a00/0x5d2988b0929cf307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf30e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514557:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599527.514559:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514562:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b340030800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599527.514564:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514569:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599527.514575:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599527.514580:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787599527.514582:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787599527.514586:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:2.0:1787599527.514588:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.514624:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599527.514626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599527.514628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599527.514699:0:15713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787599527.514704:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b340030800/0x5d2988b0929cf57d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf584 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599527.514718:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787599527.514723:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787599527.514725:0:15713:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787599527.514751:0:15713:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787599527.514755:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787599527.514759:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599527.514764:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599527.514768:0:15713:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff96b242c3b370) has no exports 00000020:00080000:1.0:1787599527.514788:0:15713:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff96b242c3b370) has no exports 00010000:00010000:3.0:1787599527.515267:0:10397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787599527.517293:0:15713:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b243084c60 - data ffff96b36633f0d8/ffff96b24337a400 00000020:01000000:1.0:1787599527.517499:0:15713:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b243198900 - data ffff96b3662350d8/ffff96b243379400 00100000:10000000:1.0:1787599527.532445:0:15713:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787599527.545232:0:15713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf18d 00000020:00000080:0.0:1787599527.545245:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b242dfa000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787599527.545262:0:15713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f896800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787599527.545266:0:15713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f896800 2 00000020:01000004:0.0:1787599527.545269:0:15713:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b37f896800 from lustre-OST0001 00000020:00000080:0.0:1787599527.545295:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599527.545301:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b242dfa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787599527.545305:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787599527.545309:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b242df8800/lustre-OST0001_UUID 00000020:00000080:0.0:1787599527.545312:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff96b242df8800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787599527.545322:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787599527.546189:0:15713:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 06cde0c1-6e67-4be0-92c4-a9f33549d8e6->MGS 00010000:00010000:0.0:1787599527.546205:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341496400/0x5d2988b0929ceee6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599527.546219:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341496400/0x5d2988b0929ceee6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599527.546227:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787599527.546230:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787599527.546234:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787599527.546257:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:0.0:1787599527.546267:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341496400/0x5d2988b0929ceee6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929ceeed expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.546284:0:15713:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599527.546301:0:15713:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599527.546306:0:15713:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599527.546309:0:15713:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787599527.546311:0:15713:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787599527.546321:0:15713:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b353223800 00010000:00010000:0.0:1787599527.546324:0:15713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b341496600/0x5d2988b0929cf369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929cf370 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787599527.546341:0:15713:0:(import.c:65:import_set_state_nolock()) ffff96b353223800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787599527.546344:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787599527.546347:0:15713:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787599527.546348:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787599527.546352:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787599527.548044:0:15713:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b38138f480 x1874433578013568/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787599534 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787599527.548074:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787599527.548078:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787599527.548230:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06cde0c1-6e67-4be0-92c4-a9f33549d8e6:3644:1874433578013568:0@lo:250:kworker.0 10000000:01000000:0.0:1787599527.549473:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787599527.549490:0:15713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cede3 00000020:00000080:0.0:1787599527.549499:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b34dd60000/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 00000020:01000000:0.0:1787599527.549520:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:0.0:1787599527.549527:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599527.549535:0:15713:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1787599527.549539:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34dd60000/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 for MGC192.168.202.101@tcp 00000020:00080000:0.0:1787599527.549540:0:15713:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff96b34dcf99b8) has no exports 10000000:01000000:3.0:1787599527.549607:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787599527.550076:0:15713:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:0.0:1787599527.550084:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787599527.550087:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787599527.550089:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787599527.550102:0:15713:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787599527.550148:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599527.550156:0:15713:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid 06cde0c1-6e67-4be0-92c4-a9f33549d8e6) 00000020:00000080:2.0:1787599527.550159:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b353223800 for MGC192.168.202.101@tcp 00000020:01000000:0.0:1787599527.550163:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787599527.550168:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b34553d800/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 00000020:00000080:0.0:1787599527.550168:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599527.550174:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34553d800/06cde0c1-6e67-4be0-92c4-a9f33549d8e6 for MGC192.168.202.101@tcp 00000020:00000080:0.0:1787599527.550175:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:01000000:2.0:1787599527.550183:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (06cde0c1-6e67-4be0-92c4-a9f33549d8e6) 00000020:00080000:0.0:1787599527.550184:0:15713:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96b2430bc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599527.550191:0:15713:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff96b37f89b370) has exports, disconnecting them 00000020:00080000:0.0:1787599527.550195:0:15713:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96b2430bc000), last request at 1787599312 00000020:00000080:0.0:1787599527.550199:0:15713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf1b7 00000020:00080000:0.0:1787599527.550211:0:15713:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b2430bc000): rc 0 00000020:00000080:0.0:1787599527.550216:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b2430bc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787599527.550945:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430bc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787599527.553909:0:15713:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787599527.553919:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599527.553923:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599527.553931:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599527.554120:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599527.554128:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787599527.554146:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787599527.554152:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599527.554156:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787599527.554163:0:15713:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff96b2430be000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599527.554169:0:15713:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff96b37f89cd28) has exports, disconnecting them 00000020:00080000:2.0:1787599527.554174:0:15713:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff96b2430be000), last request at 1787599312 00000020:00000080:2.0:1787599527.554178:0:15713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf1cc 00000020:00080000:2.0:1787599527.554193:0:15713:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b2430be000): rc 0 00000020:00000080:2.0:1787599527.554198:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b2430be000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787599527.554445:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2430b8800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787599527.554454:0:13886:0:(genops.c:885:class_export_put()) final put ffff96b37f8b7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787599527.554457:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f8b7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787599527.554466:0:13886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787599527.554536:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430be000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787599527.558250:0:15713:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787599527.558259:0:15713:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787599527.558263:0:15713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787599527.558271:0:15713:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787599527.558305:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2430b9800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787599527.558549:0:10398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787599527.570899:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787599527.571463:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787599527.571643:0:10397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787599527.572104:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff96b3515bc600:6504] 1 exiting: rc = 0 00000100:00100000:2.0:1787599527.572389:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96b3515bc000:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1787599527.572462:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff96b241909400:8450] 2 exiting: rc = 0 00000100:00100000:3.0:1787599527.572716:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.573414:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96b3515bd000:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1787599527.573480:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96b3515bd400:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1787599527.573912:0:15023:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96b24437ac00:15023] 3 exiting: rc = 0 00000100:00100000:2.0:1787599527.574406:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96b34edec400:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1787599527.574560:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574583:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574591:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574607:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574618:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574625:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574633:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574638:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574644:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574650:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574656:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574662:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574667:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574672:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574687:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574694:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574701:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574708:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574715:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574722:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574728:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574732:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574738:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574743:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574748:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574752:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574757:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574762:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574767:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574772:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574777:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574813:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574819:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574824:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574829:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574835:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574839:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574846:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574852:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574858:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574863:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574869:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574874:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574879:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574884:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574889:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574894:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574899:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574904:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574910:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574915:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574920:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574926:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574932:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574937:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.574943:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575148:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575155:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575160:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575165:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575170:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575176:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575181:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.575187:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787599527.576228:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599527.576239:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787599527.576256:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b2430ba800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787599527.576261:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430ba800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787599527.576267:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787599527.576437:0:15713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f896800 1 00000020:00000080:1.0:1787599527.576444:0:15713:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929cf15c 00000020:00000080:1.0:1787599527.576450:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b377b89000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787599527.576469:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787599527.576473:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599527.576478:0:15713:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599527.576481:0:15713:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff96b242c38000) has no exports 00000020:00000080:3.0:1787599527.578580:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377b89000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787599527.613554:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599527.613570:0:15713:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787599527.613576:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b37f890800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787599527.613581:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f890800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787599527.613605:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787599527.614246:0:15713:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b37f897800 00000020:01000000:1.0:1787599527.614326:0:15713:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787599527.614332:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599527.614337:0:15713:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599527.614342:0:15713:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96b3706f3370) has no exports 00000020:00000080:1.0:1787599527.614368:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599527.614375:0:15713:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787599527.614378:0:15713:0:(genops.c:885:class_export_put()) final put ffff96b377a82000/OSS_uuid 00000020:00000080:1.0:1787599527.614381:0:15713:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377a82000/OSS_uuid for OSS 00000020:01000000:1.0:1787599527.614385:0:15713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787599527.614466:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96b3778d9a00:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1787599527.614491:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96b377925200:8436] 2 exiting: rc = 0 00000100:00100000:0.0:1787599527.614530:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96b3778d9600:8435] 1 exiting: rc = 0 00000100:00080000:2.0:1787599527.614549:0:6516:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787599527.614930:0:8629:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96b2419c4e00:8629] 3 exiting: rc = 0 00000100:00100000:1.0:1787599527.615000:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615009:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615015:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615091:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615099:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615105:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615110:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615115:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615121:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615126:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615130:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615133:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615145:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615149:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615152:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615156:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615160:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615164:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615167:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615170:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615173:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615176:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615179:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615182:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615185:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615187:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615190:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615193:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615196:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615199:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615202:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615205:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615208:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615212:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615215:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615218:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615221:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615224:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615227:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615229:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615233:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615235:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615239:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615242:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615245:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615249:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615252:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615258:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615261:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615264:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615320:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615327:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615331:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615335:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615340:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615345:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615349:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615355:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615360:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615365:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615371:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615374:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615378:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.615381:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599527.616115:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96b3778ab600:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1787599527.616208:0:10101:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff96b2421ec200:10101] 2 exiting: rc = 0 00000100:00100000:0.0:1787599527.616385:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96b3812bf000:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1787599527.616434:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616446:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616473:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616479:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616489:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616497:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616504:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616509:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616514:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616519:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616524:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616528:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616533:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616537:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616541:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616545:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616550:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616555:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616576:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616581:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616585:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616590:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616604:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616615:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616621:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616627:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616632:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616638:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616643:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616648:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616652:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616657:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616661:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616666:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616671:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616675:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616686:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616691:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616695:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616700:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616705:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616710:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616715:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616719:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616724:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616728:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616732:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616736:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.616741:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617238:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617248:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617255:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617262:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617278:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617286:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617293:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617298:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617307:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617326:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617334:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617341:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617349:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617353:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.617363:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599527.618365:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96b34de50c00:8439] 0 exiting: rc = 1 00000100:00100000:3.0:1787599527.618875:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96b377a27200:8441] 2 exiting: rc = 0 00000100:00100000:0.0:1787599527.619581:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96b3812f8c00:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1787599527.619661:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619670:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619676:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619696:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619702:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619708:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619713:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619719:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619724:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619743:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619749:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619754:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619961:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619968:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619974:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619979:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619985:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619992:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.619997:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620002:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620006:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620012:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620017:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620021:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620038:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620044:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620049:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620055:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620060:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620065:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620070:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620076:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620082:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620105:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620112:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620117:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620123:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620128:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620133:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620139:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620144:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620149:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620155:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620160:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620165:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620170:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620175:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620179:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620185:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620189:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620194:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620200:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620205:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620210:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620215:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620222:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620228:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620234:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620243:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620256:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620264:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620281:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620291:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.620308:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599527.626989:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96b377a27a00:8442] 0 exiting: rc = 1 00000100:00100000:2.0:1787599527.627220:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96b377a26600:8443] 1 exiting: rc = 0 00000100:00100000:1.0:1787599527.627337:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627344:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627350:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627355:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627360:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627365:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627371:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627376:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627381:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627386:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627391:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627397:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627402:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627407:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627412:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627418:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627423:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627428:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627434:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627439:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627443:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627448:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627453:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627458:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627463:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627468:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627474:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627479:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627484:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627489:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627506:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627511:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627517:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627522:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627526:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627532:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627537:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627541:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627547:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627552:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627558:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627563:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627568:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627573:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627578:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627583:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627588:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627605:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627611:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627616:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627622:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627628:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627633:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627639:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627644:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627649:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627654:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627659:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627666:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627671:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627689:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627696:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627702:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.627708:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599527.628952:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96b381b38200:8444] 0 exiting: rc = 1 00000100:00100000:1.0:1787599527.629882:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96b381b39800:8445] 1 exiting: rc = 0 00000100:00100000:3.0:1787599527.629948:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.629957:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.629963:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.629969:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.629995:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630002:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630009:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630015:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630022:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630029:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630048:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630056:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630062:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630070:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630078:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630084:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630109:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630119:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630125:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630131:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630137:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630146:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630152:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630158:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630164:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630170:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630176:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630181:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630200:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630207:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630213:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630218:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630225:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630230:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630237:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630242:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630255:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630264:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630270:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630276:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630295:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630301:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630307:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630313:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630320:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630337:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630345:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630351:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630358:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630621:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630629:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.630636:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631536:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631552:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631566:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631579:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631602:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631612:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631618:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631623:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631628:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631633:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631639:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599527.631643:0:15713:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787599527.657582:0:15713:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787599548.462425:0:16477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787599561.053492:0:17077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787599561.053499:0:17077:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787599561.053501:0:17077:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787599561.057915:0:17077:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b377a86000 00000020:01000004:2.0:1787599561.057949:0:17077:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787599561.057961:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787599561.057982:0:17077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96b3706f3370) 00000020:00000080:2.0:1787599561.057998:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787599561.136135:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787599561.137340:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787599561.138162:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.139391:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.140164:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787599561.140449:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.140715:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787599561.141157:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787599561.141410:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787599561.142455:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.142845:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.143060:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787599561.143938:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787599561.144127:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.146560:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.148077:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.148396:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.148602:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.149105:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.149865:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.150118:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.150415:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.151619:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.152385:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.152827:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.153520:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.153925:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.154394:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.154650:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.154974:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.155182:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.155513:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.155967:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.156409:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.157088:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.157619:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.158038:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.158293:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.158577:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.158886:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.159315:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.159668:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.161236:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.161585:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.161870:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.162014:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787599561.162333:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787599561.163340:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.163939:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.164138:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.165275:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.165925:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787599561.166271:0:17077:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1787599561.167525:0:17077:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787599561.168146:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787599561.168155:0:17077:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787599561.168170:0:17077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d03a0 00000020:01000004:3.0:1787599561.168177:0:17077:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787599561.168183:0:17077:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787599561.168189:0:17077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b377a86000 from MGS 00000020:01000004:3.0:1787599561.168193:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787599561.168205:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96b37f89b370) 00000020:00000080:3.0:1787599561.168216:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787599561.168360:0:17077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b377a86000 from MGS, refs=2 00080000:01000000:3.0:1787599561.168365:0:17077:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787599561.168371:0:17077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d03ae 00000100:00100000:3.0:1787599561.168548:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787599561.168928:0:17077:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787599561.168935:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787599561.171982:0:17077:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787599561.172358:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787599561.173477:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599561.173873:0:17077:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787599561.173880:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787599561.175535:0:17077:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787599561.175546:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787599561.176118:0:17077:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787599561.176125:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787599561.177054:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599561.177064:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599561.177066:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599561.177365:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599561.177369:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599561.177370:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599561.178131:0:17077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787599561.186862:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787599561.191695:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787599561.192751:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787599561.192837:0:17077:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787599561.192886:0:17077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787599561.195061:0:17077:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787599561.195381:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599561.195566:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787599561.195572:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787599561.196230:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787599561.196237:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787599561.196546:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787599561.196552:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787599561.197411:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787599561.197434:0:17077:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:1.0:1787599561.197435:0:17077:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787599561.197479:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:1.0:1787599561.197493:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff96b370778000) 00000020:00000080:1.0:1787599561.197510:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787599561.197605:0:17077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b244429800@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1787599561.198948:0:17077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:1.0:1787599561.198960:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787599561.199309:0:17093:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787599561.205652:0:17094:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787599561.210441:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 0656b88f-dbfb-4f1b-a90c-8b5223ca997d) 00000020:00000080:1.0:1787599561.210481:0:17077:0:(genops.c:1385:class_connect()) connect: client 0656b88f-dbfb-4f1b-a90c-8b5223ca997d, cookie 0x5d2988b0929d03bc 00000100:00080000:1.0:1787599561.210499:0:17077:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599561.210508:0:17077:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b244429800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599561.210550:0:17077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e7b80 x1874433578014080/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599561.210593:0:17077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS 00000020:01000004:1.0:1787599561.210622:0:17077:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787599561.210628:0:17077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787599561.210645:0:17077:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96b3707799b8) 00000020:00000080:1.0:1787599561.210675:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787599561.210857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578014080:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787599561.210943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.211027:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014080 00000100:00100000:3.0:1787599561.211037:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014080 00000100:00100000:3.0:1787599561.211074:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599561.211084:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1874433578014080:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787599561.211109:0:17090:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0656b88f-dbfb-4f1b-a90c-8b5223ca997d@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1787599561.211147:0:17090:0:(genops.c:1385:class_connect()) connect: client 0656b88f-dbfb-4f1b-a90c-8b5223ca997d, cookie 0x5d2988b0929d03ca 00000100:00080000:3.0:1787599561.211273:0:17090:0:(import.c:65:import_set_state_nolock()) ffff96b24411a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599561.211341:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+5:3644:x1874433578014080:12345-0@lo:250:mount.lustre.0 Request processed in 257us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.211350:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599561.211397:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787599561.211407:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:3.0:1787599561.211415:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787599561.211420:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787599561.211423:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787599561.211426:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787599561.211437:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787599561.211442:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578014080:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787599561.217846:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599561.218057:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787599561.218063:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787599561.227339:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787599561.227355:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787599561.232951:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787599561.232966:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787599561.235947:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599561.236150:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787599561.236157:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787599561.245431:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787599561.245450:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787599561.299750:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599561.300005:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787599561.300014:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787599561.303963:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787599561.303980:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787599561.304909:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599561.305224:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599561.305230:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787599561.306227:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599561.306235:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787599561.307635:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599561.307862:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599561.307868:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787599561.314047:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599561.314070:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787599561.322358:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599561.322569:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599561.322576:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787599561.323534:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599561.323543:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787599561.353014:0:17077:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599561.353241:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599561.353248:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787599561.366890:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599561.366913:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787599561.368126:0:17077:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599561.368139:0:17077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787599561.374023:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787599561.374072:0:17077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787599561.374078:0:17077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787599561.374281:0:17077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787599561.374343:0:17077:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787599561.374348:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787599561.374350:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599561.374351:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599561.374352:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599561.374354:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599561.374355:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599561.374356:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599561.374358:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599561.374359:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599561.374361:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599561.374363:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787599561.374365:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599561.374366:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599561.374367:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599561.374368:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599561.374369:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599561.374370:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599561.374371:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599561.374372:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599561.374373:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599561.374374:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599561.374424:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787599561.374447:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599561.374523:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599561.374630:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353499e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.377323:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014208 00000100:00100000:3.0:1787599561.377340:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014208 00000100:00100000:3.0:1787599561.377463:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599561.377477:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+5:17077:x1874433578014208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787599561.377556:0:17092:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787599561.377560:0:17092:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787599561.377563:0:17092:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787599561.378706:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787599561.379202:0:17092:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787599561.380647:0:17114:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787599561.380656:0:17114:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787599561.380659:0:17114:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787599561.380662:0:17114:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787599561.380888:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787599561.381087:0:17092:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787599561.381099:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787599561.384401:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+5:17077:x1874433578014208:12345-0@lo:253:mount.lustre.0 Request processed in 6917us (9866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599561.384418:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599561.384519:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787599561.384536:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787599561.384539:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599561.384540:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787599561.384542:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599561.384543:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599561.384544:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599561.384545:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599561.384547:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599561.384549:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787599561.384550:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599561.384552:0:17077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599561.384573:0:17077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b377a86000 from lustre-MDT0000 10000000:01000000:1.0:1787599561.384602:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787599561.384605:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787599561.384608:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96b370778000 10000000:01000000:1.0:1787599561.384612:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599561.384619:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b370778000 from 1 10000000:01000000:1.0:1787599561.384622:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599561.384659:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.384670:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.384697:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599561.384718:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599561.384753:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599561.387900:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599561.391633:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014336 00000100:00100000:2.0:1787599561.391649:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014336 00000100:00100000:1.0:1787599561.391892:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599561.391905:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+5:17077:x1874433578014336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599561.391926:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599561.391954:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152a400/0x5d2988b0929d03d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d03d1 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.391985:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152a400/0x5d2988b0929d03d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d03d1 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.391996:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152a400/0x5d2988b0929d03d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d03d1 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.392007:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a400, rc 0) 00000100:00100000:1.0:1787599561.392101:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+6:17077:x1874433578014336:12345-0@lo:101:mount.lustre.0 Request processed in 198us (7346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599561.392108:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599561.392214:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599561.392234:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.392264:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.392372:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599561.392407:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.392449:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599561.392619:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014464 00000100:00100000:1.0:1787599561.392624:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014464 00000100:00100000:1.0:1787599561.392647:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599561.392654:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+6:17077:x1874433578014464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599561.392740:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+6:17077:x1874433578014464:12345-0@lo:501:mount.lustre.0 Request processed in 86us (332us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599561.392757:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599561.392842:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787599561.392880:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787599561.392902:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.392911:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599561.392921:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b377a86000 10000000:01000000:2.0:1787599561.392926:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787599561.392931:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b377a86000 10000000:01000000:2.0:1787599561.392934:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787599561.392938:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b377a86000 from 1 10000000:01000000:2.0:1787599561.392941:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787599561.392966:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.392974:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.392983:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.393003:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599561.393029:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.393051:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599561.393136:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014592 00000100:00100000:1.0:1787599561.393141:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014592 00000100:00100000:1.0:1787599561.393173:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599561.393181:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+6:17077:x1874433578014592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599561.393190:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599561.393200:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152ac00/0x5d2988b0929d03e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d03df expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393217:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152ac00/0x5d2988b0929d03e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d03df expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393226:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152ac00/0x5d2988b0929d03e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d03df expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393234:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ac00, rc 0) 00000100:00100000:1.0:1787599561.393262:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+7:17077:x1874433578014592:12345-0@lo:101:mount.lustre.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599561.393268:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599561.393407:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599561.393420:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.393429:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599561.393442:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787599561.393447:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.393453:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599561.393536:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787599561.393541:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599561.393546:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b377a86000 10000000:01000000:2.0:1787599561.393548:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787599561.393551:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787599561.393554:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599561.393568:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.393576:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.393591:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.393606:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599561.393635:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.393654:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599561.393704:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014720 00000100:00100000:1.0:1787599561.393709:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014720 00000100:00100000:1.0:1787599561.393729:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599561.393735:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+7:17077:x1874433578014720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599561.393743:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599561.393750:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152b400/0x5d2988b0929d03f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d03ed expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393763:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152b400/0x5d2988b0929d03f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d03ed expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393780:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152b400/0x5d2988b0929d03f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d03ed expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.393787:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152b400, rc 0) 00000100:00100000:1.0:1787599561.393841:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+8:17077:x1874433578014720:12345-0@lo:101:mount.lustre.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599561.393848:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599561.393916:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599561.393926:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.393934:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.393980:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599561.394003:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.394032:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599561.394078:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014848 00000100:00100000:1.0:1787599561.394082:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014848 00000100:00100000:1.0:1787599561.394100:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599561.394105:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+8:17077:x1874433578014848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599561.394237:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17077:x1874433578014848:12345-0@lo:501:mount.lustre.0 Request processed in 131us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599561.394244:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599561.394369:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599561.394394:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599561.394430:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.394449:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599561.394585:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578014976 00000100:00100000:0.0:1787599561.394590:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578014976 00000100:00100000:0.0:1787599561.394693:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599561.394700:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17077:x1874433578014976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599561.395453:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17077:x1874433578014976:12345-0@lo:503:mount.lustre.0 Request processed in 751us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599561.395598:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599561.395706:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578014976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599561.402214:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17115:1874433578015104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599561.402324:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599561.402423:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.402521:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578015104 00000100:00100000:3.0:1787599561.402529:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578015104 00000100:00100000:3.0:1787599561.402633:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599561.402644:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17115:x1874433578015104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.403356:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17115:x1874433578015104:12345-0@lo:502:llog_process_th.0 Request processed in 712us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.403365:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599561.403481:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17115:1874433578015104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599561.403514:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.403525:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.403527:0:17115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787599561.403531:0:17115:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787599561.403535:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599561.403550:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96b37077cd28) 00000020:00000080:1.0:1787599561.403567:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787599561.403572:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787599561.403669:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787599561.403677:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0402 00000020:00000080:1.0:1787599561.403906:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787599561.403911:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.403915:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.403917:0:17115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787599561.403919:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.403922:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.403924:0:17115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787599561.403927:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599561.403936:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96b37077b370) 00000020:00000080:1.0:1787599561.403945:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787599561.403949:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787599561.403951:0:17115:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787599561.403954:0:17115:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787599561.403960:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787599561.404021:0:17115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b377a86000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787599561.404036:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96b3707b8000) 00000020:00000080:1.0:1787599561.404044:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787599561.404088:0:17115:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787599561.404093:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0417 00000020:00000080:1.0:1787599561.404196:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787599561.404202:0:17115:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787599561.404207:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d2988b0929d041e 00080000:01000000:1.0:1787599561.404211:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787599561.404215:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0425 00010000:00010000:2.0:1787599561.548761:0:17115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787599561.550588:0:17115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787599561.551387:0:17115:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787599561.554848:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96b3706f4d28) 00000020:00000080:2.0:1787599561.554876:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787599561.554979:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599561.554987:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0433 00000020:00000080:3.0:1787599561.563089:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787599561.572062:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d2988b0929d043a 00000020:00000080:2.0:1787599561.589090:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787599561.589107:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599561.589114:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.589116:0:17115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787599561.589120:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599561.589122:0:17115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787599561.589124:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599561.589126:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599561.589127:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599561.589130:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.589131:0:17115:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599561.589133:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599561.589138:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.589139:0:17115:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787599561.589144:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787599561.589309:0:17115:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787599561.589332:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599561.589336:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.589337:0:17115:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787599561.589340:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599561.589344:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.589345:0:17115:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787599561.589348:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599561.589353:0:17115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:2.0:1787599561.589383:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599561.589401:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff96b3706f19b8) 00000020:00000080:2.0:1787599561.589420:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787599561.589425:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599561.589553:0:17115:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787599561.589571:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787599561.589578:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0448 00010000:00080000:2.0:1787599561.589624:0:17115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3707b2800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599561.599109:0:17115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787599561.602970:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599561.602984:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787599561.603024:0:17115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787599561.603045:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d044f 00000100:00080000:1.0:1787599561.603056:0:17115:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599561.603061:0:17115:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599561.603096:0:17115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e6a00 x1874433578015232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599561.603131:0:17115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787599561.603271:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.603275:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.603277:0:17115:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787599561.603280:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599561.603283:0:17115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787599561.603284:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599561.603286:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599561.603288:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599561.603291:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.603293:0:17115:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599561.603306:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599561.603311:0:17115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787599561.603315:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.603317:0:17115:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787599561.603319:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599561.603323:0:17115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1787599561.603349:0:17115:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787599561.603352:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599561.603365:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96b3707bb370) 00000020:00000080:1.0:1787599561.603376:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787599561.603380:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787599561.603728:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599561.603821:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599561.603948:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578015232 00000100:00100000:1.0:1787599561.603956:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578015232 00000100:00100000:1.0:1787599561.603993:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599561.604002:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578015232:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787599561.604018:0:17102:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:0.0:1787599561.608740:0:17115:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787599561.608759:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787599561.608776:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d045d 00010000:00080000:0.0:1787599561.608838:0:17115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b244394800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1787599561.609095:0:17115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787599561.613724:0:17115:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787599561.613923:0:17115:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787599561.615432:0:17115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599561.615686:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787599561.628661:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787599561.632641:0:17121:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787599561.632652:0:17121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787599561.635344:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599561.642354:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599561.642428:0:17115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599561.642456:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0464 00000100:00080000:2.0:1787599561.642470:0:17115:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599561.642477:0:17115:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b244394800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599561.642516:0:17115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b370013480 x1874433578015360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599561.642538:0:17115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599561.646468:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599561.646480:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.646483:0:17115:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599561.646487:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599561.646489:0:17115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787599561.646491:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599561.646493:0:17115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599561.646494:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599561.646497:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.646499:0:17115:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599561.646502:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599561.646508:0:17115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787599561.646512:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599561.646514:0:17115:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787599561.646517:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599561.646522:0:17115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1787599561.646550:0:17115:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787599561.646553:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599561.646589:0:17115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96b3706f0000) 00000020:00000080:2.0:1787599561.646616:0:17115:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787599561.646623:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599561.646720:0:17115:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787599561.646726:0:17115:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787599561.646734:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0472 00010000:00080000:2.0:1787599561.646767:0:17115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3707b7000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599561.647017:0:17115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787599561.647087:0:17115:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787599561.647102:0:17115:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787599561.649322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015360:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787599561.649385:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578015360 offset 0 length 520: 4 00000100:00100000:0.0:1787599561.649833:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578015232:12345-0@lo:38:llog_process_th.0 Request processed in 45826us (46008us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599561.649848:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787599561.650137:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599561.650142:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599561.650146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015232:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787599561.653615:0:17115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599561.654948:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787599561.655530:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787599561.658065:0:17123:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787599561.658072:0:17123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787599561.659719:0:17115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787599561.659737:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787599561.659784:0:17115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787599561.659843:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0479 00000100:00080000:3.0:1787599561.659856:0:17115:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599561.659875:0:17115:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599561.659919:0:17115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405f480 x1874433578015488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599561.659948:0:17115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787599561.660009:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599561.660013:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599561.660015:0:17115:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787599561.660018:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599561.660021:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599561.660023:0:17115:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599561.660026:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599561.660028:0:17115:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599561.660030:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599561.660032:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599561.660034:0:17115:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787599561.660036:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599561.660038:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599561.660039:0:17115:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787599561.660043:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787599561.660075:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17115:1874433578015616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599561.660402:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787599561.660438:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578015488 offset 0 length 520: 4 00000100:00100000:3.0:1787599561.660652:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.660717:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345cc4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599561.663730:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578015616 00000100:00100000:2.0:1787599561.663745:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578015616 00000100:00100000:2.0:1787599561.663880:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599561.663892:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17115:x1874433578015616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599561.664257:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17115:x1874433578015616:12345-0@lo:502:llog_process_th.0 Request processed in 366us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599561.664265:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599561.669743:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17115:1874433578015616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599561.669862:0:17115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599561.669875:0:17115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599561.669877:0:17115:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787599561.669882:0:17115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787599561.670116:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787599561.670147:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787599561.670262:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.670355:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599561.670365:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b377a86000 from 1 10000000:01000000:2.0:1787599561.670368:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599561.670417:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.670446:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.670456:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.670555:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578015744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599561.670634:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.670722:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599561.671026:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578015744 00000100:00100000:1.0:1787599561.671037:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578015744 00000100:00100000:1.0:1787599561.671156:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599561.671175:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+9:17077:x1874433578015744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599561.671190:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599561.671205:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0480 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.671228:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.671238:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.671247:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a600, rc 0) 00000100:00100000:1.0:1787599561.671311:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+10:17077:x1874433578015744:12345-0@lo:101:mount.lustre.0 Request processed in 138us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599561.671318:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599561.671393:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578015744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599561.671407:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.671417:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.671964:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578015872:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787599561.672003:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.672550:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599561.672598:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578015872 00000100:00100000:0.0:1787599561.672661:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578015872 00000100:00100000:3.0:1787599561.672714:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599561.672726:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+10:17077:x1874433578015872:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787599561.672749:0:17092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787599561.672763:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787599561.672868:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+10:17077:x1874433578015872:12345-0@lo:256:mount.lustre.0 Request processed in 144us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.672876:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599561.672955:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578015872:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787599561.673718:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599561.673744:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.673756:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599561.673779:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b377a86000 from 1 10000000:01000000:2.0:1787599561.673782:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599561.673846:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.673855:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.673864:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.673883:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599561.673925:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.673956:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.674048:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016000 00000100:00100000:3.0:1787599561.674054:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016000 00000100:00100000:3.0:1787599561.674087:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599561.674094:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+10:17077:x1874433578016000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599561.674105:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599561.674119:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d048e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.674140:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d048e expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.674162:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d048e expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.674171:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200de00, rc 0) 00000100:00100000:3.0:1787599561.674201:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016000:12345-0@lo:101:mount.lustre.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.674208:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599561.674389:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599561.674406:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.674413:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.674545:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599561.674570:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.674599:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.674643:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016128 00000100:00100000:3.0:1787599561.674648:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016128 00000100:00100000:3.0:1787599561.674667:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599561.674673:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599561.675019:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016128:12345-0@lo:501:mount.lustre.0 Request processed in 344us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.675026:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599561.675254:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599561.675360:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599561.675405:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.675531:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.676104:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016256 00000100:00100000:3.0:1787599561.676112:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016256 00000100:00100000:2.0:1787599561.676901:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599561.676913:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599561.677062:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016256:12345-0@lo:503:mount.lustre.0 Request processed in 151us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599561.677070:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599561.677201:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599561.677776:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17125:1874433578016384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599561.677848:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599561.677882:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b346241540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.677944:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016384 00000100:00100000:3.0:1787599561.677949:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016384 00000100:00100000:3.0:1787599561.677985:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599561.677993:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17125:x1874433578016384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.678770:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17125:x1874433578016384:12345-0@lo:502:llog_process_th.0 Request processed in 775us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.678780:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599561.678904:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17125:1874433578016384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599561.678934:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.678943:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.678946:0:17125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599561.678953:0:17125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b377a86000 00000020:00000080:1.0:1787599561.678957:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599561.678964:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.678967:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.678968:0:17125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787599561.678971:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.678973:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.678980:0:17125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599561.678984:0:17125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b377a86000 00000020:00000080:1.0:1787599561.678987:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599561.679036:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.679040:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.679041:0:17125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787599561.679044:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.679047:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.679048:0:17125:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599561.679052:0:17125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b377a86000 00000020:00000080:1.0:1787599561.679054:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599561.679073:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.679076:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.679078:0:17125:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599561.679080:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599561.679083:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.679084:0:17125:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787599561.679088:0:17125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b377a86000 00000020:00000080:1.0:1787599561.679090:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599561.679129:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17125:1874433578016512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599561.679239:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599561.679362:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347f61180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599561.683303:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016512 00000100:00100000:2.0:1787599561.683319:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016512 00000100:00100000:2.0:1787599561.683390:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599561.683404:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17125:x1874433578016512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599561.687609:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17125:x1874433578016512:12345-0@lo:502:llog_process_th.0 Request processed in 4197us (8358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599561.687624:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599561.687763:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17125:1874433578016512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599561.688256:0:17125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599561.688266:0:17125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599561.688346:0:17125:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787599561.688353:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787599561.694925:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787599561.694979:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599561.695111:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.695126:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599561.695207:0:17077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787599561.695211:0:17077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b377a86000 10000000:01000000:3.0:1787599561.695214:0:17077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b377a86000 10000000:01000000:3.0:1787599561.695218:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599561.695225:0:17077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b377a86000 from 1 10000000:01000000:3.0:1787599561.695228:0:17077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787599561.695278:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.695287:0:17077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.695322:0:17077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599561.695354:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599561.695432:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.696124:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345cc49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.696551:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016640 00000100:00100000:3.0:1787599561.696561:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016640 00000100:00100000:3.0:1787599561.696616:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599561.696628:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17077:x1874433578016640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599561.696644:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599561.696662:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c600/0x5d2988b0929d04a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d049c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.696691:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c600/0x5d2988b0929d04a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d049c expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.696703:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c600/0x5d2988b0929d04a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d049c expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.696713:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c600, rc 0) 00000100:00100000:3.0:1787599561.696775:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578016640:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.696781:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599561.699375:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599561.699405:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599561.699427:0:17077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599561.700330:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599561.700397:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.700445:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345cc49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.701378:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016768 00000100:00100000:3.0:1787599561.701390:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016768 00000100:00100000:3.0:1787599561.701452:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599561.702436:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578016768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599561.702708:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578016768:12345-0@lo:501:mount.lustre.0 Request processed in 288us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.702717:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599561.702809:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599561.702854:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599561.702900:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.702929:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578016896 00000100:00100000:3.0:1787599561.702935:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578016896 00000100:00100000:3.0:1787599561.702964:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787599561.702971:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578016896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599561.705048:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345cc49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.706646:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578016896:12345-0@lo:503:mount.lustre.0 Request processed in 3665us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.706661:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599561.707570:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578016896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599561.709129:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.709358:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.709397:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b345cc4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599561.710446:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017024 00000100:00100000:2.0:1787599561.710533:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017024 00000100:00100000:2.0:1787599561.710599:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599561.710609:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599561.710819:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017024:12345-0@lo:502:llog_process_th.0 Request processed in 183us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599561.710827:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787599561.711784:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017024:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787599561.711884:0:17130:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787599561.711902:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96b37f89cd28) 00000020:00000080:3.0:1787599561.711923:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787599561.712030:0:17130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b377a86000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787599561.712034:0:17130:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b377a86000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787599561.712037:0:17130:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b377a86000 4 00010000:00080000:3.0:1787599561.712069:0:17130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3778e6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599561.716131:0:17130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787599561.716384:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787599561.716429:0:17130:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599561.716447:0:17130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d2988b0929d04b1 00000100:00080000:3.0:1787599561.716459:0:17130:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599561.716466:0:17130:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96b3778e6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599561.716509:0:17130:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405f100 x1874433578017152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599561.716561:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578017152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599561.716639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599561.716696:0:17130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787599561.718617:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017152 00000100:00100000:2.0:1787599561.718633:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017152 00000100:00100000:2.0:1787599561.718673:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599561.718691:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578017152:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599561.718833:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578017152:12345-0@lo:38:llog_process_th.0 Request processed in 143us (2192us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787599561.718841:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599561.718886:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599561.718894:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3778e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599561.718898:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787599561.718901:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578017152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599561.723343:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.723432:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.723616:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017280 00000100:00100000:3.0:1787599561.723626:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017280 00000100:00100000:3.0:1787599561.723682:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599561.723692:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.723842:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017280:12345-0@lo:502:llog_process_th.0 Request processed in 151us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.723852:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599561.723897:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.723921:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.723958:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.723989:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599561.724009:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017408 00000100:00100000:3.0:1787599561.726270:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017408 00000100:00100000:3.0:1787599561.726359:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599561.726372:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599561.727366:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17130:x1874433578017408:12345-0@lo:502:llog_process_th.0 Request processed in 992us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.727377:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599561.729284:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599561.729342:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17130:1874433578017408:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787599561.729385:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787599561.735070:0:17077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787599561.735125:0:17077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599561.737783:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.737828:0:17077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787599561.737912:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787599561.737915:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599561.737916:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599561.737918:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599561.737919:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599561.737921:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599561.737922:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599561.737925:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599561.737927:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599561.737928:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599561.737933:0:17077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787599561.737935:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599561.737937:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599561.737938:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599561.737939:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599561.737940:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599561.737947:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599561.737948:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599561.737949:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599561.737950:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599561.737951:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599561.737983:0:17077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787599561.738009:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578017536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599561.738094:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.738145:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599561.740085:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017536 00000100:00100000:0.0:1787599561.740102:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017536 00000100:00100000:0.0:1787599561.740258:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599561.740270:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578017536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599561.740331:0:17092:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787599561.740346:0:17092:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787599561.750188:0:17092:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787599561.750208:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787599561.750693:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17077:x1874433578017536:12345-0@lo:253:mount.lustre.0 Request processed in 10420us (12593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599561.750706:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599561.750778:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17077:1874433578017536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599561.750821:0:17077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787599561.750834:0:17077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599561.750836:0:17077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599561.750838:0:17077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599561.750839:0:17077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599561.750840:0:17077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599561.750842:0:17077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599561.750843:0:17077:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599561.750845:0:17077:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599561.750846:0:17077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599561.750848:0:17077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599561.750864:0:17077:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787599561.752888:0:17113:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787599561.752898:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787599561.752930:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.752963:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 11 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.752973:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.753024:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 11 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.753040:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 11 pid: 17090 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.753056:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578017664:0@lo:104: 00000100:00100000:2.0:1787599561.753120:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.753190:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599561.753328:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017664 00000100:00100000:0.0:1787599561.753336:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017664 00000100:00100000:0.0:1787599561.753391:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599561.753402:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578017664:12345-0@lo:104: 00010000:00010000:0.0:1787599561.753414:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.753539:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578017664:0@lo:104: 00010000:00010000:2.0:1787599561.753572:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599561.760034:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599561.760049:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578017664:12345-0@lo:104: Request processed in 6645us (6925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599561.760061:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787599561.760140:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599561.760211:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.760233:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599561.760237:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.760247:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599561.760254:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599561.760259:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599561.760362:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.760369:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599561.760394:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.760401:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d0480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0487 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599561.760418:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599561.760420:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599561.760422:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599561.760468:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578017792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599561.760544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599561.761699:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017792 00000100:00100000:2.0:1787599561.761710:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017792 00010000:00010000:2.0:1787599561.761751:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 12 pid: 17090 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.761787:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599561.761819:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:3648:x1874433578017792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599561.761832:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599561.761837:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 12 pid: 17090 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761849:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 12 pid: 17090 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761866:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a600/0x5d2988b0929d0487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0480 expref: 12 pid: 17090 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761881:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761889:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599561.761907:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009009474s 00010000:00010000:2.0:1787599561.761912:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761919:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761940:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761946:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761953:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599561.761958:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761966:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761982:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.761993:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599561.762051:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:3648:x1874433578017792:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599561.762059:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787599561.762086:0:17113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.762094:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599561.762101:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759000/0x5d2988b0929d04b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599561.762138:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578017792:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787599561.771037:0:17077:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787599561.773215:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787599561.773611:0:17137:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787599561.773616:0:17137:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787599561.776782:0:17138:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787599561.777235:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599561.779323:0:17138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787599561.779422:0:17138:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1787599561.780347:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1787599561.786610:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787599561.786660:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787599561.787032:0:17139:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96b370010380 x1874433578017920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599561.787046:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000004:00000080:0.0:1787599561.787710:0:17077:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787599561.787721:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787599561.787780:0:17077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599561.789255:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787599561.790056:0:17077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787599561.790098:0:17077:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787599561.791699:0:17077:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1787599561.794559:0:17077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787599561.796762:0:17077:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787599561.796832:0:17077:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1441c53988 00100000:10000000:1.0:1787599561.796842:0:17077:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787599561.797461:0:17077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599561.797478:0:17077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599561.797499:0:17077:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787599561.797523:0:17077:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787599561.798567:0:17077:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599561.798767:0:17077:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599562.213533:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599562.791201:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787599562.791632:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 10000000:01000000:0.0:1787599562.980864:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599562.980873:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b377a86000 from 7 10000000:01000000:0.0:1787599562.980878:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599562.980931:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599562.980957:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599562.980969:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599562.980996:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578018048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599562.981070:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599562.981146:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3706b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599562.981229:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018048 00000100:00100000:1.0:1787599562.981238:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018048 00000100:00100000:1.0:1787599562.981311:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599562.981320:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+11:17094:x1874433578018048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599562.981333:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599562.981347:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d04bf expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599562.981371:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599562.981380:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599562.981390:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152bc00, rc 0) 00000100:00100000:1.0:1787599562.981438:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17094:x1874433578018048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599562.981445:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599562.981702:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578018048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599562.981719:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599562.981729:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599562.981780:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578018176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787599562.981839:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599562.981868:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3706b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599562.981919:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018176 00000100:00100000:2.0:1787599562.981924:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018176 00000100:00100000:2.0:1787599562.981951:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599562.981958:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17094:x1874433578018176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787599562.981972:0:17092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599562.981987:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599562.981990:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787599562.982079:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17094:x1874433578018176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599562.982087:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599562.982152:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578018176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787599562.982192:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599562.982198:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599562.982207:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599563.241103:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599563.812917:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000040:00080000:2.0:1787599563.814414:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599564.266596:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599564.836867:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787599565.287702:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599565.863914:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787599566.309428:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599566.885010:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787599566.885313:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1787599566.885332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787599566.885337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787599566.885340:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599566.885348:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:0.0:1787599566.885353:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787599566.885359:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599566.885384:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138dc00 x1874433578018432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599566.885401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599566.885405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599566.885408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599566.885412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599566.885415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787599566.885418:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787599566.885420:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3778e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599566.885425:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96b3778e6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599566.885438:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138d880 x1874433578018560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599566.885858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578018432:0@lo:38:kworker.0 00000100:00100000:1.0:1787599566.885941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599566.886005:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578018560:0@lo:38:kworker.0 00000100:00100000:1.0:1787599566.886038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599566.886086:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018432 00000100:00100000:1.0:1787599566.886093:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018432 00000100:00100000:1.0:1787599566.886127:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599566.886135:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578018432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787599566.886154:0:17103:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599566.886754:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018560 00000100:00100000:3.0:1787599566.886759:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018560 00000100:00100000:3.0:1787599566.886786:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599566.886812:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578018560:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787599566.886832:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1787599566.886872:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d2988b0929d04cd 00000004:00100000:3.0:1787599566.886888:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599566.887777:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b2434d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599566.888108:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874433578018560:12345-0@lo:38:kworker.0 Request processed in 1102us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599566.888120:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599566.890971:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578018304:0@lo:400:kworker.0 00000100:00100000:2.0:1787599566.891054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599566.904132:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018304 00000100:00100000:0.0:1787599566.904153:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018304 00000100:00100000:0.0:1787599566.904268:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599566.904281:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:3646:x1874433578018304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599566.904418:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:3646:x1874433578018304:12345-0@lo:400:kworker.0 Request processed in 131us (13355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599566.904426:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599566.904514:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578018304:0@lo:400:kworker.0 00010000:00080000:2.0:1787599566.907728:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b38138d880 x1874433578018560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599566.907753:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787599566.907762:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787599566.907777:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787599566.907780:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3778e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787599566.907787:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578018560:0@lo:38:kworker.0 00000100:00100000:1.0:1787599566.909152:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578018432:12345-0@lo:38:kworker.0 Request processed in 23011us (23205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787599566.909166:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787599566.909592:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599566.909598:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599566.909602:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578018432:0@lo:38:kworker.0 00010000:00010000:0.0:1787599567.339337:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599567.383445:0:17381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787599567.909358:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787599568.371481:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787599568.510256:0:17434:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599568.511585:0:17434:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787599568.934296:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599569.383779:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599569.568601:0:17484:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599569.570193:0:17484:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787599569.956994:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787599570.405941:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599570.983348:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599571.430892:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599572.006127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787599572.006135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787599572.006138:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599572.006146:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1787599572.006152:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787599572.006158:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599572.006180:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e4000 x1874433578018816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599572.006197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599572.006200:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599572.006214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599572.006217:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599572.006256:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578018688:0@lo:400:kworker.0 00000100:00100000:1.0:1787599572.006330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599572.006402:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599561/real 1787599561] req@ffff96b24405f480 x1874433578015488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599571 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599572.006422:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b24405f480 x1874433578015488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599571 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599572.006432:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599561/real 1787599561] req@ffff96b370013480 x1874433578015360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599571 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599572.006444:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b370013480 x1874433578015360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599571 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599572.006454:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578018816:0@lo:38:kworker.0 00000100:00100000:1.0:1787599572.006478:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787599572.006503:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599572.006514:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599572.006518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015488:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787599572.006523:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599572.006528:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599572.006531:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578015360:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787599572.006561:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018688 00000100:00100000:1.0:1787599572.006567:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018688 00000100:00100000:1.0:1787599572.006610:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599572.006619:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:3646:x1874433578018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599572.006663:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:3646:x1874433578018688:12345-0@lo:400:kworker.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599572.006680:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599572.006724:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578018688:0@lo:400:kworker.0 00000100:00080000:1.0:1787599572.006738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599572.006741:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787599572.006742:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599572.006745:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:1.0:1787599572.006748:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787599572.006751:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b244394800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599572.006762:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e7100 x1874433578019072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599572.006774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599572.006777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599572.006778:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599572.006781:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:1.0:1787599572.006783:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787599572.006786:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599572.006819:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e7800 x1874433578019200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599572.006838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578019072:0@lo:8:kworker.0 00000400:00000100:1.0:1787599572.006861:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578019072 offset 0 length 520: 4 00000100:00100000:1.0:1787599572.006873:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578019200:0@lo:8:kworker.0 00000400:00000100:1.0:1787599572.006889:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578019200 offset 0 length 520: 4 00000100:00100000:2.0:1787599572.009319:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578018944:0@lo:400:kworker.0 00000100:00100000:2.0:1787599572.009388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599572.009462:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018944 00000100:00100000:2.0:1787599572.009470:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018944 00000100:00100000:2.0:1787599572.009511:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599572.009521:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578018944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599572.009572:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578018944:12345-0@lo:400:kworker.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599572.009579:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787599572.009617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b2443e4a80 x1874433578018944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599572.009630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578018944:0@lo:400:kworker.0 00000100:00100000:1.0:1787599572.012462:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000100:00100000:1.0:1787599572.012893:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578018816 00000100:00100000:1.0:1787599572.012904:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578018816 00000100:00100000:1.0:1787599572.012956:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599572.012965:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578018816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787599572.012986:0:17102:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787599572.032058:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578018816:12345-0@lo:38:kworker.0 Request processed in 19085us (25569us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787599572.032073:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787599572.032376:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599572.032383:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599572.032387:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578018816:0@lo:38:kworker.0 00010000:00010000:1.0:1787599572.456300:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599573.034412:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000040:00080000:0.0:1787599573.035216:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599573.476952:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599574.054770:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787599574.501966:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599575.079896:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599575.524974:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599576.101272:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787599576.550282:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787599576.613099:0:17829:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787599576.613104:0:17829:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787599576.613105:0:17829:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787599576.613243:0:17829:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b37f890800 00000020:01000004:0.0:1787599576.613462:0:17829:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787599576.613475:0:17829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787599576.613491:0:17829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff96b242c3b370) 00000020:00000080:0.0:1787599576.613506:0:17829:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787599576.745481:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787599576.745722:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787599576.747692:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787599576.748566:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787599576.748764:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787599576.749550:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787599576.750611:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787599576.751471:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787599576.752362:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787599576.752714:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787599576.758769:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787599576.759670:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787599576.759970:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787599576.760400:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787599576.768185:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787599576.769645:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787599576.770243:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787599576.770494:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787599576.770785:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787599576.771790:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787599576.774208:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.776344:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.776834:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.779506:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.782220:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.782664:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.783187:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.783472:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.783758:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.784142:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.784473:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.786078:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.787747:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.789247:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787599576.792265:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.793596:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787599576.794029:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787599576.794441:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787599576.794917:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787599576.795186:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787599576.795437:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787599576.796205:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787599576.797187:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787599576.797994:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787599576.799478:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787599576.800827:0:17829:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00080000:01000000:0.0:1787599576.805483:0:17829:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787599576.805827:0:17829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787599576.805839:0:17829:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787599576.805865:0:17829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d04db 00000020:01000004:0.0:1787599576.805875:0:17829:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787599576.805895:0:17829:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787599576.805899:0:17829:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787599576.805905:0:17829:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787599576.805935:0:17829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787599576.805940:0:17829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787599576.819183:0:17829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599576.819234:0:17829:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787599576.819239:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599576.819241:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787599576.819242:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599576.819244:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599576.819245:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599576.819246:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599576.819248:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599576.819250:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599576.819251:0:17829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599576.819255:0:17829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787599576.819257:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599576.819259:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787599576.819260:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599576.819261:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599576.819262:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599576.819263:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599576.819264:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599576.819270:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599576.819271:0:17829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599576.819313:0:17829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787599576.820062:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599576.820135:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599576.820242:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.827483:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019328 00000100:00100000:0.0:1787599576.827497:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019328 00000100:00100000:1.0:1787599576.827650:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599576.827661:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17829:x1874433578019328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787599576.827710:0:17090:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787599576.827714:0:17090:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787599576.827721:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787599576.828129:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17829:x1874433578019328:12345-0@lo:253:mount.lustre.0 Request processed in 469us (7992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599576.828158:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787599576.828217:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787599576.828232:0:17829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787599576.828236:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599576.828237:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787599576.828238:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599576.828240:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599576.828241:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599576.828242:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599576.828243:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599576.828245:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599576.828247:0:17829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787599576.828271:0:17829:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b37f890800 from lustre-MDT0001 10000000:01000000:2.0:1787599576.828301:0:17829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787599576.828304:0:17829:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787599576.828311:0:17829:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b370778000 local copy 00010000:00010000:2.0:1787599576.828322:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599576.828421:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599576.828457:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599576.830410:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019456 00000100:00100000:3.0:1787599576.830426:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019456 00000100:00100000:2.0:1787599576.830449:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599576.830516:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787599576.830527:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17829:x1874433578019456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599576.830645:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17829:x1874433578019456:12345-0@lo:501:mount.lustre.0 Request processed in 119us (2186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599576.830670:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599576.830691:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019456:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787599576.830713:0:17829:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787599576.830745:0:17829:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787599576.830760:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599576.830770:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599576.830852:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b37f890800 10000000:01000000:3.0:1787599576.830858:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787599576.830863:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96b370778000 10000000:01000000:3.0:1787599576.830866:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787599576.830869:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96b370778000 from 1 10000000:01000000:3.0:1787599576.830872:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787599576.830907:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599576.830916:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599576.830925:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599576.830944:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599576.830984:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599576.831015:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599576.831444:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019584 00000100:00100000:1.0:1787599576.831452:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019584 00000100:00100000:1.0:1787599576.831498:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599576.831507:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+12:17829:x1874433578019584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599576.831516:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599576.831530:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152ae00/0x5d2988b0929d04e9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d04e2 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599576.831553:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152ae00/0x5d2988b0929d04e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d04e2 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599576.831563:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152ae00/0x5d2988b0929d04e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d04e2 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599576.831572:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152ae00, rc 0) 00000100:00100000:1.0:1787599576.831608:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+13:17829:x1874433578019584:12345-0@lo:101:mount.lustre.0 Request processed in 103us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599576.831614:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599576.831720:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599576.831735:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.831744:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599576.831762:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787599576.831781:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.831788:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599576.831824:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b37f890800 10000000:01000000:0.0:1787599576.831829:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787599576.831833:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b37f890800 from 1 10000000:01000000:0.0:1787599576.831835:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787599576.831865:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.831883:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.831892:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599576.831907:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599576.831939:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599576.831965:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019712 00000100:00100000:0.0:1787599576.831969:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019712 00000100:00100000:0.0:1787599576.831998:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599576.832005:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+13:17829:x1874433578019712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599576.832012:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599576.832023:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5400/0x5d2988b0929d04f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d04f0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832037:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5400/0x5d2988b0929d04f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d04f0 expref: 14 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832045:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5400/0x5d2988b0929d04f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d04f0 expref: 14 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832052:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5400, rc 0) 00000100:00100000:0.0:1787599576.832512:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+14:17829:x1874433578019712:12345-0@lo:101:mount.lustre.0 Request processed in 506us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599576.832518:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599576.832556:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.832575:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599576.832587:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832595:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599576.832606:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787599576.832624:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832632:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599576.832638:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787599576.832642:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599576.832646:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b37f890800 10000000:01000000:0.0:1787599576.832648:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787599576.832651:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787599576.832653:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787599576.832669:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832687:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832695:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599576.832708:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599576.832744:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599576.832766:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019840 00000100:00100000:0.0:1787599576.832771:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019840 00000100:00100000:0.0:1787599576.832820:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599576.832828:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+14:17829:x1874433578019840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599576.832836:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599576.832857:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5c00/0x5d2988b0929d0505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d04fe expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832872:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5c00/0x5d2988b0929d0505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d04fe expref: 15 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832879:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5c00/0x5d2988b0929d0505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d04fe expref: 15 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832887:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5c00, rc 0) 00000100:00100000:0.0:1787599576.832913:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578019840:12345-0@lo:101:mount.lustre.0 Request processed in 86us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599576.832919:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599576.832948:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.832960:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599576.832970:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599576.832977:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599576.839541:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787599576.841470:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599576.867182:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787599576.869053:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787599576.869102:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787599576.869120:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787599576.869153:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787599576.869183:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787599576.872276:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787599576.872360:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787599576.872381:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787599576.872397:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787599576.872412:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787599576.872428:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787599576.872443:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787599576.872461:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787599576.872474:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787599576.872487:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787599576.872506:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787599576.872519:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787599576.872531:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787599576.872544:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787599576.872555:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787599576.872567:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787599576.872589:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787599576.872622:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787599576.872628:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787599576.872752:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599576.872859:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599576.872903:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.877503:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578019968 00000100:00100000:0.0:1787599576.877537:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578019968 00000100:00100000:0.0:1787599576.877596:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599576.877606:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578019968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599576.877858:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578019968:12345-0@lo:501:mount.lustre.0 Request processed in 251us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599576.877866:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599576.878340:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578019968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599576.878393:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599576.878450:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599576.878487:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.878662:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020096 00000100:00100000:0.0:1787599576.878668:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020096 00000100:00100000:0.0:1787599576.878716:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599576.878724:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578020096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599576.879902:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578020096:12345-0@lo:503:mount.lustre.0 Request processed in 1172us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599576.879915:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599576.880031:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599576.880505:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599576.880594:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599576.880635:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599576.880660:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.882337:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020224 00000100:00100000:0.0:1787599576.882353:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020224 00000100:00100000:0.0:1787599576.882424:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599576.882434:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578020224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599576.894310:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578020224:12345-0@lo:502:mount.lustre.0 Request processed in 11867us (13664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599576.894432:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599576.894727:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787599576.894760:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787599576.894777:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787599576.894788:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787599576.894838:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787599576.894850:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787599576.894861:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787599576.894872:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787599576.894883:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787599576.894897:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787599576.894909:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787599576.894920:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787599576.894931:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787599576.894942:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787599576.894955:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787599576.894966:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787599576.894981:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787599576.894992:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787599576.895004:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787599576.895016:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787599576.895026:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787599576.895036:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787599576.895047:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787599576.895080:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787599576.895094:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787599576.895105:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787599576.895117:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787599576.895128:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787599576.895139:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787599576.895152:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787599576.895187:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787599576.895204:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787599576.895218:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787599576.895230:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787599576.895241:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787599576.895253:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787599576.895266:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787599576.895280:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787599576.895291:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787599576.895303:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787599576.895315:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787599576.895339:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787599576.895354:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787599576.895365:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787599576.895403:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599576.895471:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599576.895505:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599576.896017:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020352 00000100:00100000:0.0:1787599576.896027:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020352 00000100:00100000:0.0:1787599576.896095:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599576.896104:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578020352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599576.896249:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578020352:12345-0@lo:502:mount.lustre.0 Request processed in 146us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599576.896257:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599576.896861:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578020352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599576.896933:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787599576.896945:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000100:00100000:1.0:1787599576.897442:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:01000000:2.0:1787599576.900732:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599576.900754:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599576.900757:0:17833:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599576.900763:0:17833:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787599576.900766:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599576.900830:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff96b37b5d8000) 00000020:00000080:2.0:1787599576.900852:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787599576.900860:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787599576.900948:0:17833:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599576.900958:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0513 00000020:00000080:2.0:1787599576.901557:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787599576.901562:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599576.901566:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599576.901568:0:17833:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599576.901571:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599576.901574:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599576.901576:0:17833:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787599576.901579:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599576.901587:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff96b37b5db370) 00000020:00000080:2.0:1787599576.901598:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787599576.901602:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787599576.901604:0:17833:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787599576.901606:0:17833:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787599576.901612:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599576.901672:0:17833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f890800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787599576.901699:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff96b37b5dcd28) 00000020:00000080:2.0:1787599576.901709:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787599576.901772:0:17833:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787599576.901779:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0528 00000020:00000080:2.0:1787599576.901920:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787599576.901928:0:17833:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787599576.901933:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5d2988b0929d052f 00080000:01000000:2.0:1787599576.901939:0:17833:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787599576.901942:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0536 00010000:00010000:2.0:1787599577.066552:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787599577.069338:0:17833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787599577.073199:0:17833:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787599577.074391:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787599577.074406:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599577.074413:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599577.074415:0:17833:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787599577.074419:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599577.074426:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599577.074428:0:17833:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787599577.074431:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599577.074436:0:17833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:2.0:1787599577.074465:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599577.074481:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff96b37b5d99b8) 00000020:00000080:2.0:1787599577.074505:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787599577.074510:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599577.074576:0:17833:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787599577.074586:0:17833:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787599577.074593:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0544 00010000:00080000:2.0:1787599577.074643:0:17833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2437f2000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599577.081349:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787599577.087025:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599577.087041:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787599577.087079:0:17833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787599577.087105:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d054b 00000100:00080000:1.0:1787599577.087118:0:17833:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599577.087124:0:17833:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b2437f2000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599577.087184:0:17833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e5880 x1874433578020480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599577.087209:0:17833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787599577.087264:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.087269:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087271:0:17833:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787599577.087274:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599577.087276:0:17833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787599577.087277:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.087279:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.087280:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599577.087283:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087284:0:17833:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599577.087287:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599577.087291:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087292:0:17833:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787599577.087296:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787599577.087325:0:17833:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787599577.087338:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.087341:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087342:0:17833:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787599577.087345:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599577.087346:0:17833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787599577.087347:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.087348:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.087350:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599577.087352:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087353:0:17833:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599577.087356:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599577.087358:0:17833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787599577.087361:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.087363:0:17833:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787599577.087366:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599577.087376:0:17833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1787599577.087401:0:17833:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787599577.087404:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599577.087418:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff96b3707b99b8) 00000020:00000080:1.0:1787599577.087430:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787599577.087435:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599577.087525:0:17833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787599577.087532:0:17833:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787599577.087539:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0559 00010000:00080000:1.0:1787599577.087570:0:17833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b34631c800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.101@tcp at head 00000100:00100000:3.0:1787599577.087767:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578020480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599577.087854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599577.087919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787599577.087929:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787599577.087932:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599577.087936:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1787599577.087941:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599577.087945:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599577.087963:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405f800 x1874433578020608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599577.087978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599577.087981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599577.087984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599577.087987:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599577.088016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578020608:0@lo:38:kworker.0 00000100:00100000:3.0:1787599577.088044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599577.088759:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020480 00000100:00100000:2.0:1787599577.088768:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020480 00000100:00100000:2.0:1787599577.088848:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020608 00000100:00100000:2.0:1787599577.088852:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020608 00000100:00100000:2.0:1787599577.088867:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599577.088875:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578020480:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787599577.088898:0:17103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1787599577.088934:0:17103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0560 00000004:00100000:2.0:1787599577.088950:0:17103:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787599577.088956:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787599577.089040:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578020736:0@lo:400:kworker.0 00000100:00100000:2.0:1787599577.089081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599577.089120:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020736 00000100:00100000:2.0:1787599577.089124:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020736 00000100:00100000:2.0:1787599577.089152:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599577.089157:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578020736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599577.089218:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578020736:12345-0@lo:400:kworker.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.089225:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599577.089263:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b24405ca80 x1874433578020736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599577.089275:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578020736:0@lo:400:kworker.0 00010000:00010000:1.0:1787599577.091605:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1787599577.093885:0:17833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787599577.094450:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787599577.105277:0:17833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599577.105655:0:17833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787599577.105851:0:17833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1787599577.106290:0:17838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787599577.106295:0:17838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787599577.110985:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599577.111000:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787599577.111046:0:17833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787599577.111072:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0567 00000100:00080000:1.0:1787599577.111096:0:17833:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599577.111102:0:17833:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b34631c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599577.111138:0:17833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e6d80 x1874433578020864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599577.111170:0:17833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787599577.111223:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.111228:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.111230:0:17833:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787599577.111249:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599577.111251:0:17833:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787599577.111253:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.111255:0:17833:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599577.111256:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599577.111258:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.111259:0:17833:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599577.111262:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599577.111265:0:17833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787599577.111269:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.111270:0:17833:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787599577.111273:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599577.111276:0:17833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1787599577.111299:0:17833:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787599577.111302:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599577.111313:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff96b3707bcd28) 00000020:00000080:1.0:1787599577.111337:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787599577.111343:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599577.111418:0:17833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787599577.111425:0:17833:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787599577.111432:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0575 00010000:00080000:1.0:1787599577.111463:0:17833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b242df9000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1787599577.111655:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787599577.111727:0:17833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787599577.111742:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787599577.112841:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578020864:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787599577.112907:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578020864 offset 0 length 520: 4 00000100:00080000:0.0:1787599577.113037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599577.113043:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599577.113053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599577.113056:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787599577.114123:0:17833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599577.114365:0:17833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787599577.114485:0:17833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:1.0:1787599577.115054:0:17103:0:(import.c:65:import_set_state_nolock()) ffff96b242df8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599577.115170:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578020480:12345-0@lo:38:llog_process_th.0 Request processed in 26283us (27304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.115182:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599577.115226:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599577.115233:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578020608:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787599577.115280:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578020608:12345-0@lo:38:kworker.0 Request processed in 46us (27236us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787599577.115287:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599577.115370:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599577.115382:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599577.115387:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787599577.115391:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578020608:0@lo:38:kworker.0 00000100:00100000:3.0:1787599577.115407:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599577.115413:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787599577.115422:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787599577.115429:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599577.115432:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599577.115452:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578020480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599577.115666:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578020992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599577.115707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599577.115780:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578020992 00000100:00100000:0.0:1787599577.115786:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578020992 00000100:00100000:0.0:1787599577.115868:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599577.115876:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874433578020992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599577.115900:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787599577.115944:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874433578020992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599577.115949:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599577.115985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578020992:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787599577.120441:0:17840:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787599577.120451:0:17840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1787599577.129055:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000020:00000080:1.0:1787599577.130581:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599577.130596:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787599577.130636:0:17833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787599577.130660:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d057c 00000100:00080000:1.0:1787599577.130671:0:17833:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599577.130677:0:17833:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599577.130714:0:17833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e4380 x1874433578021120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599577.130778:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578021120:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787599577.130869:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578021120 offset 0 length 520: 4 00000100:00080000:1.0:1787599577.131035:0:17833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787599577.131124:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.131129:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.131131:0:17833:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787599577.131135:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599577.131139:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.131140:0:17833:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599577.131143:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599577.131145:0:17833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787599577.131147:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.131150:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.131151:0:17833:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787599577.131153:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599577.131155:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.131156:0:17833:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787599577.131184:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787599577.131218:0:17833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599577.131221:0:17833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599577.131222:0:17833:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787599577.131226:0:17833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1787599577.131454:0:17829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787599577.131489:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787599577.131509:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.131521:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599577.131530:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f890800 from 1 10000000:01000000:3.0:1787599577.131533:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599577.131560:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.131567:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.131577:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599577.131593:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599577.131633:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.131654:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599577.131888:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021248 00000100:00100000:1.0:1787599577.131897:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021248 00000100:00100000:1.0:1787599577.131944:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599577.131954:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+15:17829:x1874433578021248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599577.131967:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599577.131979:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0583 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.132001:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.132011:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.132019:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a200, rc 0) 00000100:00100000:1.0:1787599577.132063:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578021248:12345-0@lo:101:mount.lustre.0 Request processed in 110us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.132071:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599577.132144:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599577.132168:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.132191:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599577.132722:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021376:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787599577.132763:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.132789:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599577.132935:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021376 00000100:00100000:1.0:1787599577.132941:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021376 00000100:00100000:1.0:1787599577.132979:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787599577.132987:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578021376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787599577.133001:0:17092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787599577.133020:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787599577.133023:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787599577.133119:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578021376:12345-0@lo:256:mount.lustre.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.133126:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599577.133246:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021376:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787599577.133872:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599577.133889:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.133899:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599577.133907:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f890800 from 1 10000000:01000000:3.0:1787599577.133910:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599577.133934:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.133942:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.133950:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599577.133965:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599577.134001:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.134042:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.134064:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021504 00000100:00100000:3.0:1787599577.134069:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021504 00000100:00100000:3.0:1787599577.134096:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599577.134104:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17829:x1874433578021504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599577.134112:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599577.134125:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0591 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.134143:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.134152:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.134169:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c800, rc 0) 00000100:00100000:3.0:1787599577.134201:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021504:12345-0@lo:101:mount.lustre.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.134208:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599577.134244:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599577.134256:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.134264:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599577.134389:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599577.134419:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599577.134445:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.134465:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.134480:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021632 00000100:00100000:3.0:1787599577.134484:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021632 00000100:00100000:3.0:1787599577.134507:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599577.134513:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599577.134587:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021632:12345-0@lo:501:mount.lustre.0 Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.134594:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599577.134627:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599577.134651:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599577.134688:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.134702:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.134714:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021760 00000100:00100000:3.0:1787599577.134717:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021760 00000100:00100000:3.0:1787599577.134739:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787599577.134745:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599577.134839:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021760:12345-0@lo:503:mount.lustre.0 Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.134846:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787599577.134884:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599577.135248:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599577.135323:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599577.135359:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.135373:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.135388:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578021888 00000100:00100000:3.0:1787599577.135391:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578021888 00000100:00100000:3.0:1787599577.135420:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599577.135426:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599577.135498:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578021888:12345-0@lo:502:mount.lustre.0 Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.135506:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599577.135544:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578021888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599577.135711:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787599577.135738:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1787599577.135754:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1787599577.135770:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1787599577.135782:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1787599577.135817:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1787599577.135833:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1787599577.135847:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1787599577.135861:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787599577.135874:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1787599577.135888:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1787599577.135910:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599577.135945:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.135961:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.135975:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022016 00000100:00100000:3.0:1787599577.135979:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022016 00000100:00100000:3.0:1787599577.136001:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599577.136008:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578022016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599577.136081:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578022016:12345-0@lo:502:mount.lustre.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.136088:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599577.136127:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022016:0@lo:502:mount.lustre.0 00000100:00080000:0.0:1787599577.136816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599577.136822:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599577.136825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599577.136828:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787599577.141594:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1787599577.141621:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787599577.146599:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599577.146613:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.146616:0:17842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787599577.146625:0:17842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f890800 00000020:00000080:0.0:1787599577.146628:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599577.146637:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599577.146639:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.146641:0:17842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787599577.146643:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599577.146657:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.146659:0:17842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787599577.146662:0:17842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f890800 00000020:00000080:0.0:1787599577.146665:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599577.146780:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599577.146783:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.146785:0:17842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787599577.146787:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599577.146789:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.147959:0:17842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599577.147974:0:17842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f890800 00000020:00000080:0.0:1787599577.147977:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599577.155658:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599577.155674:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.155677:0:17842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599577.155682:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599577.155686:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.155688:0:17842:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787599577.155693:0:17842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f890800 00000020:00000080:0.0:1787599577.155695:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599577.155775:0:17842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599577.155780:0:17842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599577.155781:0:17842:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787599577.155784:0:17842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787599577.156012:0:17829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787599577.156059:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599577.156083:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156095:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599577.156177:0:17829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787599577.156181:0:17829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b37f890800 10000000:01000000:3.0:1787599577.156184:0:17829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b37f890800 10000000:01000000:3.0:1787599577.156188:0:17829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599577.156194:0:17829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37f890800 from 1 10000000:01000000:3.0:1787599577.156197:0:17829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787599577.156237:0:17829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156246:0:17829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156257:0:17829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599577.156283:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599577.156369:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.156411:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022144 00000100:00100000:3.0:1787599577.156418:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022144 00000100:00100000:3.0:1787599577.156460:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599577.156469:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17829:x1874433578022144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599577.156494:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599577.156507:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c400/0x5d2988b0929d05a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d059f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156533:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c400/0x5d2988b0929d05a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d059f expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156543:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c400/0x5d2988b0929d05a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d059f expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156552:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599577.156587:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022144:12345-0@lo:101:mount.lustre.0 Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.156595:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599577.156640:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.156662:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599577.156676:0:17829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.156685:0:17829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599577.159150:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787599577.160012:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599577.162289:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787599577.164181:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787599577.164223:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787599577.164238:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787599577.164253:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787599577.164280:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787599577.164294:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787599577.164321:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787599577.165612:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787599577.165628:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787599577.165642:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787599577.165655:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787599577.165668:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787599577.165680:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787599577.165693:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787599577.165706:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787599577.165719:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787599577.165733:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787599577.165746:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787599577.165773:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787599577.165788:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787599577.165821:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787599577.165838:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787599577.165879:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787599577.165897:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787599577.165911:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787599577.165933:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787599577.165949:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787599577.165977:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787599577.165984:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787599577.170469:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599577.170556:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.170606:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599577.172290:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022272 00000100:00100000:1.0:1787599577.172302:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022272 00000100:00100000:1.0:1787599577.172359:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599577.172371:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599577.173302:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022272:12345-0@lo:501:mount.lustre.0 Request processed in 929us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.173311:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599577.175706:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599577.175908:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599577.176011:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.176175:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599577.181272:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022400 00000100:00100000:0.0:1787599577.181286:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022400 00000100:00100000:0.0:1787599577.181462:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599577.181474:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599577.182889:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022400:12345-0@lo:503:mount.lustre.0 Request processed in 1410us (6869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599577.182902:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599577.183008:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599577.185300:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599577.208869:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599577.208966:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599577.209020:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599577.209485:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022528 00000100:00100000:2.0:1787599577.209495:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022528 00000100:00100000:2.0:1787599577.209564:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787599577.209574:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599577.209705:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022528:12345-0@lo:502:mount.lustre.0 Request processed in 132us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.209713:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599577.212993:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599577.213287:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787599577.213318:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787599577.213332:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787599577.213346:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787599577.213357:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787599577.213369:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787599577.213382:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787599577.213396:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787599577.213410:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787599577.213424:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787599577.213438:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787599577.213452:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787599577.213467:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787599577.213480:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787599577.213492:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787599577.213519:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787599577.213532:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787599577.213545:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787599577.213558:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787599577.213571:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787599577.213584:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787599577.213597:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787599577.213611:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787599577.213625:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787599577.213637:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787599577.213649:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787599577.213678:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787599577.213690:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787599577.213702:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787599577.213714:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787599577.213727:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787599577.213738:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787599577.213749:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787599577.213966:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787599577.213984:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787599577.213999:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787599577.214014:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787599577.214029:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787599577.214448:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787599577.214469:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787599577.214483:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787599577.214497:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787599577.214528:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787599577.214544:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787599577.214555:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787599577.214567:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787599577.214579:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787599577.214591:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787599577.214651:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599577.214728:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599577.218646:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599577.234567:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022656 00000100:00100000:2.0:1787599577.234588:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022656 00000100:00100000:1.0:1787599577.234999:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787599577.235011:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599577.235207:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022656:12345-0@lo:502:mount.lustre.0 Request processed in 197us (20478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.235215:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599577.235318:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599577.235563:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1787599577.235602:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1787599577.235649:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599577.235709:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.235768:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599577.236183:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022784 00000100:00100000:1.0:1787599577.236189:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022784 00000100:00100000:1.0:1787599577.236236:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599577.236246:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599577.236394:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578022784:12345-0@lo:502:mount.lustre.0 Request processed in 149us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.236409:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599577.236500:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578022784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599577.236562:0:17829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1787599577.236577:0:17829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787599577.256040:0:17848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787599577.256070:0:17848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96b344af8000) 00000020:00000080:2.0:1787599577.256093:0:17848:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787599577.256194:0:17848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f890800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787599577.256198:0:17848:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f890800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787599577.256201:0:17848:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f890800 3 00010000:00080000:2.0:1787599577.256236:0:17848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3434d7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599577.257997:0:17848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787599577.258209:0:17848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787599577.258249:0:17848:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599577.258262:0:17848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5d2988b0929d05b4 00000100:00080000:2.0:1787599577.258274:0:17848:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599577.258280:0:17848:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b3434d7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599577.258345:0:17848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b370012300 x1874433578022912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599577.258370:0:17848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599577.258409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599577.258413:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599577.258415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599577.258418:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599577.258695:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578022912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599577.258774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787599577.259345:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787599577.259456:0:17829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787599577.259508:0:17829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599577.259526:0:17829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599577.259536:0:17829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599577.259599:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599577.259601:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599577.259602:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599577.259603:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599577.259604:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599577.259606:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599577.259611:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599577.259612:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599577.259613:0:17829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599577.259617:0:17829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787599577.259620:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599577.259621:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599577.259622:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599577.259623:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599577.259624:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599577.259625:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599577.259626:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599577.259627:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599577.259628:0:17829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599577.259646:0:17829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787599577.259661:0:17829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578023040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599577.259705:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.259736:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023040 00000100:00100000:3.0:1787599577.259743:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023040 00000100:00100000:3.0:1787599577.259843:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787599577.259853:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578023040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787599577.259878:0:17092:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787599577.259891:0:17092:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787599577.260140:0:17829:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599577.266836:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578022912 00000100:00100000:2.0:1787599577.266853:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578022912 00000100:00100000:2.0:1787599577.266903:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599577.266911:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578022912:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787599577.266942:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1787599577.266978:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5d2988b0929d05bb 00000004:00100000:2.0:1787599577.266996:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787599577.267041:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b3434d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599577.267136:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874433578022912:12345-0@lo:38:llog_process_th.0 Request processed in 224us (8361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.267144:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:00100000:0.0:1787599577.268366:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787599577.269736:0:17092:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00010000:00080000:1.0:1787599577.270321:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b370012300 x1874433578022912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599577.270336:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599577.270347:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787599577.270356:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787599577.270361:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599577.270364:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599577.270371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578022912:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1787599577.270450:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787599577.270924:0:17113:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599577.270930:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599577.270951:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.270968:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.270975:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.270983:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271039:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271055:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 18 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599577.271069:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578023168:0@lo:104: 00000100:00100000:0.0:1787599577.271136:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599577.271214:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271223:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 18 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599577.271232:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578023296:0@lo:104: 00000100:00100000:0.0:1787599577.271265:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599577.271283:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599577.271403:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023168 00000100:00100000:1.0:1787599577.271409:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023168 00000100:00100000:1.0:1787599577.271451:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023296 00000100:00100000:1.0:1787599577.271454:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023296 00000100:00100000:1.0:1787599577.271480:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599577.271499:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578023168:12345-0@lo:104: 00010000:00010000:1.0:1787599577.271512:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.271584:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599577.271591:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578023168:12345-0@lo:104: Request processed in 104us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.271598:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599577.271625:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599577.271632:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578023296:12345-0@lo:104: 00010000:00010000:1.0:1787599577.271639:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599577.271640:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578023168:0@lo:104: 00010000:00010000:0.0:1787599577.271651:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599577.271657:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271664:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599577.271667:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.271672:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599577.271677:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578023296:12345-0@lo:104: Request processed in 47us (411us total) trans 0 rc 0/0 00010000:00010000:0.0:1787599577.271677:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599577.271683:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:0.0:1787599577.271684:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599577.271690:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599577.271714:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271720:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599577.271756:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271763:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d0583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d058a expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271774:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599577.271776:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271788:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599577.271815:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271822:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599577.271829:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599577.271834:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599577.271851:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271858:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599577.271871:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271888:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e4400/0x5d2988b0929d04bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d04c6 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599577.271901:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599577.271902:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599577.271904:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599577.272191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578023424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599577.272281:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599577.272291:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578023552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599577.272496:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578023296:0@lo:104: 00010000:00010000:0.0:1787599577.272516:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599577.272973:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17829:x1874433578023040:12345-0@lo:253:mount.lustre.0 Request processed in 13119us (13265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.272984:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787599577.273030:0:17829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17829:1874433578023040:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599577.273040:0:17829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787599577.273044:0:17829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599577.273046:0:17829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599577.273056:0:17829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599577.273057:0:17829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599577.273059:0:17829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599577.273060:0:17829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599577.273061:0:17829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599577.273062:0:17829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599577.273064:0:17829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599577.273074:0:17829:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787599577.282527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599577.283268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599577.283373:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023424 00000100:00100000:2.0:1787599577.283384:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023424 00010000:00010000:2.0:1787599577.283441:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 18 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599577.283483:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023552 00000100:00100000:2.0:1787599577.283496:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023552 00010000:00010000:2.0:1787599577.283511:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 19 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599577.283528:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599577.283537:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3646:x1874433578023424:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599577.283553:0:17084:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787599577.283554:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599577.283560:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 19 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599577.283571:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 19 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599577.283572:0:17084:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787599577.283614:0:17085:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787599577.283624:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599577.283632:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3647:x1874433578023552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599577.283642:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599577.283647:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 19 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599577.283685:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a200/0x5d2988b0929d058a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0583 expref: 19 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289508:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 18 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289538:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d04c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d04bf expref: 18 pid: 17091 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289555:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289565:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787599577.289589:0:17085:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018659547s 00010000:00010000:1.0:1787599577.289595:0:17085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289603:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289610:0:17085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289617:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289624:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599577.289629:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289636:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289668:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.289679:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599577.289979:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:3647:x1874433578023552:12345-0@lo:103:ldlm_bl.0 Request processed in 6345us (6709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.289991:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787599577.290044:0:17113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.290053:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599577.290060:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d05c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599577.290106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578023552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599577.293732:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599577.294093:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:3646:x1874433578023424:12345-0@lo:103:ldlm_bl.0 Request processed in 10552us (11568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.294106:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599577.294272:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578023424:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787599577.304540:0:17829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787599577.304587:0:17855:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787599577.304592:0:17855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787599577.307003:0:17856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787599577.307017:0:17829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787599577.307574:0:17857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578023680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787599577.307659:0:17857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.307701:0:17857:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22180 going to sleep for 11 seconds 00000040:01000000:0.0:1787599577.307760:0:17829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1787599577.307763:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023680 00000100:00100000:2.0:1787599577.307772:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023680 00000040:00080000:0.0:1787599577.307836:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599577.307852:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599577.307864:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578023680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787599577.307951:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578023680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.307958:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599577.308126:0:17857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578023680:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787599577.308173:0:17857:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787599577.308199:0:17857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578023808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787599577.308231:0:17857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.308262:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023808 00000100:00100000:3.0:1787599577.308266:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023808 00000100:00100000:3.0:1787599577.308286:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599577.308293:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578023808:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:0.0:1787599577.308304:0:17829:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787599577.308314:0:17829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787599577.308355:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599577.308421:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578023808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 128us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599577.308429:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599577.308447:0:17857:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599577.308462:0:17857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578023808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787599577.308508:0:17857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17857:1874433578023936:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787599577.308546:0:17857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599577.308571:0:17857:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422da180 going to sleep for 11 seconds 00000040:00080000:3.0:1787599577.309255:0:17856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599577.309788:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578023936 00000100:00100000:1.0:1787599577.309812:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578023936 00000100:00100000:1.0:1787599577.309859:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599577.309869:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17857:x1874433578023936:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787599577.309940:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17857:x1874433578023936:12345-0@lo:900:lod0001_rec0000.0 Request processed in 73us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599577.309948:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787599577.311911:0:17857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b24405ca80 x1874433578023936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599593 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599577.311952:0:17857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17857:1874433578023936:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787599577.312038:0:17857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578024064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787599577.312113:0:17857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599577.312144:0:17857:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599577.312311:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024064 00000100:00100000:2.0:1787599577.312320:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024064 00000100:00100000:2.0:1787599577.312370:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599577.312381:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578024064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787599577.312481:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17857:x1874433578024064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599577.312489:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:0.0:1787599577.312753:0:17829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787599577.314592:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1787599577.314601:0:17857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17857:1874433578024064:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1787599577.314679:0:17856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787599577.314933:0:17857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599577.315896:0:17829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787599577.315967:0:17829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787599577.318155:0:17857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787599577.318260:0:17857:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787599577.318265:0:17857:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:1.0:1787599577.318788:0:17829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787599577.319435:0:17829:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1787599577.325436:0:17829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787599577.344228:0:17829:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787599577.344271:0:17829:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1441c53988 00100000:10000000:1.0:1787599577.344280:0:17829:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787599577.349710:0:17829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787599577.349748:0:17829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787599577.349774:0:17829:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787599577.349813:0:17829:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787599577.350616:0:17829:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599577.350857:0:17829:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599577.578668:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599578.148916:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000040:00080000:3.0:1787599578.279187:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599578.597052:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787599579.118198:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599579.118208:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f890800 from 8 10000000:01000000:1.0:1787599579.118224:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599579.118282:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599579.118295:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599579.118315:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599579.118365:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599579.118438:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599579.118495:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599579.118928:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024192 00000100:00100000:0.0:1787599579.118937:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024192 00000100:00100000:0.0:1787599579.118997:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599579.119007:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17094:x1874433578024192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599579.119020:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599579.119037:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d05c9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599579.119074:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599579.119085:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599579.119095:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4c00, rc 0) 00000100:00100000:0.0:1787599579.119173:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578024192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599579.119181:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599579.119247:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599579.119264:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599579.119272:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599579.119339:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787599579.119372:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599579.119396:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599579.119729:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024320 00000100:00100000:1.0:1787599579.119978:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024320 00000100:00100000:1.0:1787599579.120014:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599579.120023:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578024320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599579.120038:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599579.120057:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599579.120060:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787599579.121821:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578024320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1769us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599579.121834:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787599579.127501:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787599579.133554:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599579.133569:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599579.133583:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599579.133595:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787599579.133597:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b377a86000 from 8 10000000:01000000:3.0:1787599579.133601:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599579.133638:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599579.133646:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599579.133668:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599579.133703:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599579.133786:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599579.133853:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599579.136464:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024448 00000100:00100000:2.0:1787599579.136479:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024448 00000100:00100000:2.0:1787599579.136551:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599579.136562:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578024448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599579.136578:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599579.136597:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d05d7 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599579.136639:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 18 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599579.136650:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 18 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599579.136660:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759400, rc 0) 00000100:00100000:2.0:1787599579.136748:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578024448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599579.136755:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599579.136838:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599579.136858:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599579.136868:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599579.136947:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787599579.136990:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599579.138361:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599579.138605:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024576 00000100:00100000:0.0:1787599579.138614:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024576 00000100:00100000:0.0:1787599579.138677:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599579.138695:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578024576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787599579.138720:0:17091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599579.139023:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599579.139038:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787599579.139164:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578024576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 471us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599579.139173:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599579.140051:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578024576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787599579.140126:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599579.140137:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599579.140160:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599579.190676:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787599579.309598:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599579.627935:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599580.208332:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599580.649302:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599581.220917:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599581.679391:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599582.245836:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578024704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599582.245915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599582.246004:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024704 00000100:00100000:2.0:1787599582.246012:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024704 00000100:00100000:2.0:1787599582.246069:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599582.246080:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578024704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599582.246123:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787599582.246170:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578024704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599582.246178:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599582.246221:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578024704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599582.248233:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787599582.695001:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599582.757584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787599582.757591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787599582.757595:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599582.757607:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599582.757628:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2443e5f80 x1874433578024960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599582.757643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599582.757646:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599582.757659:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599582.757661:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599582.757687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599582.757690:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599582.757693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599582.757696:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599582.757720:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578025088:0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.757784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.757920:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599582.757927:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578024832:0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.757956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.757990:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578024960:0@lo:38:kworker.0 00000100:00100000:1.0:1787599582.758019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.758049:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578025216:0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.758074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.758091:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599582.758096:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578025344:0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.758131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.758165:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025088 00000100:00100000:1.0:1787599582.758172:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025088 00000100:00100000:1.0:1787599582.758222:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025344 00000100:00100000:1.0:1787599582.758226:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025344 00000100:00100000:1.0:1787599582.758242:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599582.758250:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578025088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599582.758459:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787599582.758468:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787599582.758609:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599582.758617:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578025344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599582.758657:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578025344:12345-0@lo:400:kworker.0 Request processed in 42us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599582.758664:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599582.758857:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578025088:12345-0@lo:400:kworker.0 Request processed in 72us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.758866:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599582.758887:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024832 00000100:00100000:1.0:1787599582.758891:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024832 00000100:00100000:1.0:1787599582.758929:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599582.758936:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:3646:x1874433578024832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.758967:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:3646:x1874433578024832:12345-0@lo:400:kworker.0 Request processed in 32us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.758972:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599582.759000:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578024960 00000100:00100000:1.0:1787599582.759004:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578024960 00000100:00100000:1.0:1787599582.759015:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025216 00000100:00100000:1.0:1787599582.759017:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025216 00000100:00100000:1.0:1787599582.759031:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599582.759036:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578024960:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787599582.759063:0:17102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1787599582.759104:0:17102:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d05e5 00000004:00100000:1.0:1787599582.759129:0:17102:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787599582.759135:0:17102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1787599582.759226:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2443e4000 x1874433578025344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599582.759241:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578025344:0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.759267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578024832:0@lo:400:kworker.0 00010000:00080000:1.0:1787599582.759279:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2443e5c00 x1874433578025088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599582.759296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578025088:0@lo:400:kworker.0 00000100:00080000:1.0:1787599582.768905:0:17102:0:(import.c:65:import_set_state_nolock()) ffff96b3440de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599582.769014:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578024960:12345-0@lo:38:kworker.0 Request processed in 9975us (10992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.769025:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599582.769052:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599582.769061:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578025216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599582.769100:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578025216:12345-0@lo:400:kworker.0 Request processed in 42us (11026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.769106:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599582.769211:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578025216:0@lo:400:kworker.0 00000100:00080000:2.0:1787599582.785965:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787599582.785981:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787599582.785988:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787599582.785992:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787599582.786011:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1d3400d): req@ffff96b370010380 x1874433578017920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599582.788475:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.788561:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599582.788592:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578017920 00000100:00100000:1.0:1787599582.788816:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578017920 00000100:00100000:1.0:1787599582.788894:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599582.788908:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578017920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.789022:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578017920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.789032:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599582.789078:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17139:1874433578017920:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787599582.789139:0:17139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787599582.789187:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17139:1874433578025472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.789218:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.789241:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599582.789254:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025472 00000100:00100000:1.0:1787599582.789264:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025472 00000100:00100000:1.0:1787599582.789287:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599582.789293:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578025472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.789458:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578025472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 164us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.789465:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599582.789492:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17139:1874433578025472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.790081:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17139:1874433578025600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.790122:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599582.790138:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423909c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599582.790153:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025600 00000100:00100000:1.0:1787599582.790156:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025600 00000100:00100000:1.0:1787599582.790184:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599582.790191:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578025600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599582.790233:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1874433578025600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599582.790239:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599582.790261:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17139:1874433578025600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787599582.790299:0:17139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599582.795304:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578024960:0@lo:38:kworker.0 00000100:00100000:3.0:1787599582.795671:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599582.795690:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578025728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599582.795764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599582.795831:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025728 00000100:00100000:3.0:1787599582.795840:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025728 00000100:00100000:3.0:1787599582.795880:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599582.795889:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578025728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599582.795924:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599582.795973:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578025728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599582.795980:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599582.796023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578025728:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787599582.796857:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787599582.796945:0:17139:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1787599582.796952:0:17139:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1787599582.868668:0:18101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787599583.269676:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599583.718944:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599584.038074:0:18153:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599584.038636:0:18153:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599584.749400:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599585.288107:0:18203:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599585.289531:0:18203:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599585.765683:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599586.788990:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599586.895359:0:18251:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd14422da0 20000000:00000080:2.0:1787599586.895377:0:18251:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b344bba400 uarg=0000000000000000 20000000:01000000:2.0:1787599586.895416:0:18251:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787599586.895422:0:18251:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787599586.895427:0:18251:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787599586.896284:0:18252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787599586.896506:0:18251:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787599586.909684:0:18251:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787599586.909718:0:18251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599586.909738:0:18251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599586.909749:0:18251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599586.909756:0:18251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599586.910161:0:18251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599586.910179:0:18251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 17 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599586.910196:0:18251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1874433578025856:0@lo:104: 00000100:00100000:0.0:1787599586.910265:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599586.910325:0:18251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599586.910335:0:18251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599586.910345:0:18251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1874433578025984:0@lo:104: 00000100:00100000:0.0:1787599586.910365:0:18251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599586.910386:0:18251:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599586.910503:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025856 00000100:00100000:1.0:1787599586.910511:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025856 00000100:00100000:1.0:1787599586.910545:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578025984 00000100:00100000:1.0:1787599586.910558:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578025984 00000100:00100000:1.0:1787599586.910572:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599586.910580:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:18251:x1874433578025856:12345-0@lo:104: 00010000:00010000:1.0:1787599586.910602:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599586.911297:0:18251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1874433578025856:0@lo:104: 00010000:00010000:1.0:1787599586.911334:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599586.911341:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:18251:x1874433578025856:12345-0@lo:104: Request processed in 762us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599586.911348:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599586.911367:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599586.911375:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:18251:x1874433578025984:12345-0@lo:104: 00010000:00010000:1.0:1787599586.911384:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599586.911462:0:18251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18251:1874433578025984:0@lo:104: 00010000:00010000:0.0:1787599586.911483:0:18251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911533:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599586.911540:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911548:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599586.911552:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911561:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599586.911569:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599586.911574:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599586.911620:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911626:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599586.911782:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599586.911789:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:18251:x1874433578025984:12345-0@lo:104: Request processed in 415us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599586.911810:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787599586.911877:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911885:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0598 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911906:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599586.911910:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911916:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599586.911919:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911926:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599586.911943:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599586.911949:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599586.911965:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911971:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599586.911986:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.911993:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d048e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0495 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599586.912005:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599586.912007:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599586.912009:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599586.912016:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599586.912032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578026112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599586.912067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599586.912125:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578026240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599586.912146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599586.912212:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026112 00000100:00100000:1.0:1787599586.912218:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026112 00010000:00010000:1.0:1787599586.912242:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 18 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599586.912271:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026240 00000100:00100000:1.0:1787599586.912275:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026240 00010000:00010000:1.0:1787599586.912285:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 19 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599586.912300:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599586.912313:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3645:x1874433578026112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599586.912324:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599586.912330:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 19 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912341:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 19 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912355:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c800/0x5d2988b0929d0598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0591 expref: 19 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912367:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599586.912392:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:3645:x1874433578026112:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599586.912398:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599586.912409:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599586.912414:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:3647:x1874433578026240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599586.912421:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599586.912425:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912434:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912454:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0495 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d048e expref: 17 pid: 17092 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912465:0:17084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912483:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912496:0:17084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912504:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912511:0:17084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912518:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912523:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599586.912527:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912534:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912556:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599586.912565:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599586.912599:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:3647:x1874433578026240:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599586.912606:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787599586.912661:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599586.912759:0:18251:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599586.912781:0:18251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599586.912788:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d05ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599586.912902:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578026240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599586.913216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578026112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599587.366049:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599587.366084:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578026368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599587.366171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599587.366377:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026368 00000100:00100000:0.0:1787599587.366386:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026368 00000100:00100000:0.0:1787599587.366447:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599587.366458:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578026368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599587.366494:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787599587.366551:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578026368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599587.366557:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599587.366741:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578026368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599587.813229:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599587.876937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.876948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599587.876951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.876953:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599587.877063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578026496:0@lo:400:kworker.0 00000100:00080000:1.0:1787599587.877122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.877125:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599587.877128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.877132:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599587.877163:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578026624:0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.877169:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599587.877201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599587.877349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578027008:0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877366:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578026752:0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.877383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599587.877395:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578026880:0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599587.877425:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578027008 00000100:00100000:0.0:1787599587.877432:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578027008 00000100:00100000:1.0:1787599587.877455:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026496 00000100:00100000:1.0:1787599587.877459:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026496 00000100:00100000:0.0:1787599587.877485:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599587.877487:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599587.877495:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877506:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:3645:x1874433578026496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.877550:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578027008:12345-0@lo:400:kworker.0 Request processed in 56us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599587.877557:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599587.877623:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:3645:x1874433578026496:12345-0@lo:400:kworker.0 Request processed in 128us (453us total) trans 0 rc 0/0 00010000:00080000:0.0:1787599587.877627:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2440ed500 x1874433578027008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.877630:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599587.877642:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578027008:0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.877655:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578026496:0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877678:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026624 00000100:00100000:1.0:1787599587.877682:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026624 00000100:00100000:1.0:1787599587.877699:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026880 00000100:00100000:1.0:1787599587.877703:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026880 00000100:00100000:1.0:1787599587.877713:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599587.877722:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578026624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877758:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578026624:12345-0@lo:400:kworker.0 Request processed in 35us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599587.877764:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599587.877777:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599587.877783:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578026880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.877786:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578026624:0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.877854:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578026880:12345-0@lo:400:kworker.0 Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599587.877860:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599587.877882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599587.877913:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578026752 00000100:00100000:0.0:1787599587.877917:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578026752 00000100:00100000:0.0:1787599587.877945:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599587.877953:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578026752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599587.878115:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578026752:12345-0@lo:400:kworker.0 Request processed in 163us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599587.878122:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787599587.878141:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2440ee300 x1874433578026752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.878153:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578026752:0@lo:400:kworker.0 00000100:00100000:1.0:1787599587.879058:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599577/real 1787599577] req@ffff96b2443e4380 x1874433578021120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879094:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2443e4380 x1874433578021120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879104:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599577/real 1787599577] req@ffff96b2443e6d80 x1874433578020864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879117:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2443e6d80 x1874433578020864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879124:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599572/real 1787599572] req@ffff96b2443e7100 x1874433578019072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879143:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2443e7100 x1874433578019072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879148:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599572/real 1787599572] req@ffff96b2443e7800 x1874433578019200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599587.879155:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2443e7800 x1874433578019200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599587.879165:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599587.879177:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599587.879179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578021120:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787599587.879183:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599587.879186:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599587.879189:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578020864:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787599587.879192:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599587.879195:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599587.879197:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578019072:0@lo:8:kworker.0 00000100:00080000:1.0:1787599587.879200:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599587.879212:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599587.879215:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578019200:0@lo:8:kworker.0 00000100:00080000:1.0:1787599587.879244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.879248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787599587.879250:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599587.879254:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1787599587.879264:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787599587.879269:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b244394800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599587.879300:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440ee300 x1874433578027136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599587.879315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.879317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599587.879318:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599587.879321:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1787599587.879323:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787599587.879325:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599587.879333:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440ec700 x1874433578027264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599587.879338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.879340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787599587.879341:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599587.879343:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1787599587.879344:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787599587.879346:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b34631c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599587.879353:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440efb80 x1874433578027392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599587.879358:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578026880:0@lo:400:kworker.0 00000100:00080000:1.0:1787599587.879360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599587.879366:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599587.879369:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599587.879371:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1787599587.879373:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787599587.879380:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599587.879388:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440ee680 x1874433578027520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599587.879410:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578027136:0@lo:8:kworker.0 00000400:00000100:1.0:1787599587.879437:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578027136 offset 0 length 520: 4 00000100:00100000:1.0:1787599587.879456:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578027264:0@lo:8:kworker.0 00000400:00000100:1.0:1787599587.879464:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578027264 offset 0 length 520: 4 00000100:00100000:1.0:1787599587.879469:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578027392:0@lo:8:kworker.0 00000400:00000100:1.0:1787599587.879479:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578027392 offset 0 length 520: 4 00000100:00100000:1.0:1787599587.879484:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578027520:0@lo:8:kworker.0 00000400:00000100:1.0:1787599587.879493:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578027520 offset 0 length 520: 4 00000100:00100000:1.0:1787599587.885691:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578027648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599587.885777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599587.885891:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578027648 00000100:00100000:0.0:1787599587.885899:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578027648 00000100:00100000:0.0:1787599587.885950:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599587.885959:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578027648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599587.885996:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787599587.886049:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874433578027648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599587.886056:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599587.886112:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578027648:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1787599588.069871:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599588.069877:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f890800 from 13 10000000:01000000:3.0:1787599588.069882:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599588.069924:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599588.069932:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599588.069941:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599588.069960:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578027776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599588.070092:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599588.070146:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599588.070221:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578027776 00000100:00100000:2.0:1787599588.070229:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578027776 00000100:00100000:1.0:1787599588.070313:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599588.070326:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+16:17094:x1874433578027776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599588.070340:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599588.070354:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d05f3 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.070376:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.070387:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.070410:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152a600, rc 0) 00000100:00100000:1.0:1787599588.070453:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578027776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599588.070460:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599588.070486:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578027776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599588.070501:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599588.070522:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599588.070584:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578027904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599588.070603:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599588.070619:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599588.070638:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578027904 00000100:00100000:1.0:1787599588.070643:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578027904 00000100:00100000:1.0:1787599588.070682:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599588.070690:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578027904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599588.070787:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578027904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599588.070823:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578027904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599588.070825:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787599588.070852:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599588.070888:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599588.070910:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599588.070920:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028032 00000100:00100000:1.0:1787599588.070925:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028032 00000100:00100000:1.0:1787599588.070943:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599588.070949:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578028032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599588.071038:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578028032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599588.071045:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787599588.071080:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787599588.071895:0:18313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787599588.072097:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787599588.072113:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599588.072120:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599588.072174:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599588.072184:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599588.072186:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b377a86000 from 13 10000000:01000000:2.0:1787599588.072188:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599588.072213:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599588.072220:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599588.072245:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599588.072264:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599588.072307:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599588.072343:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599588.072425:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028160 00000100:00100000:1.0:1787599588.072429:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028160 00000100:00100000:1.0:1787599588.072459:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599588.072464:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+17:17094:x1874433578028160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599588.072473:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599588.072489:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0601 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.072512:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.072518:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599588.072523:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b34152bc00, rc 0) 00000100:00100000:1.0:1787599588.072554:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578028160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599588.072561:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787599588.072583:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599588.072597:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599588.072605:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599588.072651:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599588.072677:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599588.072697:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599588.072745:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028288 00000100:00100000:1.0:1787599588.072748:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028288 00000100:00100000:1.0:1787599588.072775:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599588.072781:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578028288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599588.072897:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578028288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599588.072904:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599588.072936:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599588.072963:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599588.072998:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599588.073020:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599588.073077:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028416 00000100:00100000:3.0:1787599588.073082:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028416 00000100:00100000:3.0:1787599588.073111:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599588.073115:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578028416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599588.073200:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:17094:x1874433578028416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599588.073205:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787599588.073318:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578028416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599588.074091:0:18314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787599588.074289:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787599588.074306:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599588.074312:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599588.074320:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787599588.390756:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787599588.839933:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599589.546425:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599589.862483:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599590.908049:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599591.913822:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599592.487172:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578028544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599592.487295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599592.487787:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028544 00000100:00100000:0.0:1787599592.487822:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028544 00000100:00100000:0.0:1787599592.487887:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599592.487897:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578028544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599592.487931:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787599592.487989:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578028544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599592.488013:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599592.488535:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578028544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787599592.937063:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599592.997954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599592.997960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599592.997963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599592.997966:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599592.997974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599592.997977:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599592.997984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599592.997987:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599592.998046:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578028672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599592.998114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599592.998164:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578029184:0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599592.998226:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599592.998232:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578029056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599592.998283:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578028800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599592.998332:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599592.998337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578028928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599592.998385:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028672 00000100:00100000:1.0:1787599592.998392:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028672 00000100:00100000:1.0:1787599592.998424:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028928 00000100:00100000:1.0:1787599592.998428:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028928 00000100:00100000:1.0:1787599592.998441:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599592.998450:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578028672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599592.998482:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599592.998526:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578028672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599592.998533:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599592.998665:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599592.998672:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998715:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578028928:12345-0@lo:400:kworker.0 Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599592.998722:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599592.998740:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029184 00000100:00100000:1.0:1787599592.998744:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029184 00000100:00100000:1.0:1787599592.998765:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029056 00000100:00100000:1.0:1787599592.998768:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029056 00000100:00100000:1.0:1787599592.998785:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599592.998811:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578029184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998844:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578029184:12345-0@lo:400:kworker.0 Request processed in 52us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599592.998850:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599592.998861:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599592.998867:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578029056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998892:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578029056:12345-0@lo:400:kworker.0 Request processed in 25us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599592.998897:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599592.998920:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578028800 00000100:00100000:1.0:1787599592.998923:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578028800 00000100:00100000:1.0:1787599592.998949:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599592.998954:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:3645:x1874433578028800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599592.998982:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:3645:x1874433578028800:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599592.998988:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599593.000403:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578028928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599593.000418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578028800:0@lo:400:kworker.0 00010000:00080000:1.0:1787599593.000476:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2440ece00 x1874433578029056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599593.000487:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578029056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599593.000503:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578028672:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787599593.000513:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2440ed500 x1874433578029184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599593.000522:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578029184:0@lo:400:kworker.0 00000040:00080000:2.0:1787599593.510064:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599593.957076:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599594.981950:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787599595.393640:0:18600:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787599595.393644:0:18600:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787599595.393645:0:18600:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787599595.393777:0:18600:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b3440db800 00000020:01000004:1.0:1787599595.393811:0:18600:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787599595.393827:0:18600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787599595.393842:0:18600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96b34dcf99b8) 00000020:00000080:1.0:1787599595.393863:0:18600:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787599595.490927:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787599595.498315:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787599595.498478:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787599595.498739:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787599595.499116:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787599595.499360:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787599595.499585:0:18600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787599595.500643:0:18600:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787599595.501047:0:18600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787599595.501063:0:18600:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787599595.501077:0:18600:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929d0616 00000020:01000004:3.0:1787599595.501085:0:18600:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787599595.501109:0:18600:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787599595.501113:0:18600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787599595.501120:0:18600:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787599595.501125:0:18600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787599595.501140:0:18600:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96b37f898000) 00000020:00000080:3.0:1787599595.501152:0:18600:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787599595.502162:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599595.502304:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787599595.502310:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787599595.503141:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599595.503148:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787599595.503389:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599595.503394:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787599595.507460:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599595.508192:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787599595.508199:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787599595.509358:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787599595.509367:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787599595.521928:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599595.522194:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787599595.522202:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787599595.523505:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787599595.523515:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787599595.524386:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599595.524394:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787599595.526625:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599595.526774:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787599595.526778:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787599595.531572:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599595.531582:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787599595.576767:0:18600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599595.577012:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787599595.577018:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787599595.578022:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599595.578030:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787599595.578448:0:18600:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787599595.578479:0:18600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787599595.578487:0:18600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787599595.613120:0:18600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787599595.613602:0:18600:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787599595.613607:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787599595.613609:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599595.613610:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599595.613612:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599595.613613:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599595.613614:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599595.613615:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599595.613617:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599595.613617:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599595.613621:0:18600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787599595.613623:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599595.613624:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599595.613625:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599595.613625:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599595.613626:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599595.613627:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599595.613628:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599595.613629:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599595.613629:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599595.613653:0:18600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787599595.613670:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599595.613727:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599595.613770:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b377af8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.613981:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029312 00000100:00100000:2.0:1787599595.613988:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029312 00000100:00100000:2.0:1787599595.615166:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787599595.615184:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:18600:x1874433578029312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599595.615330:0:17092:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787599595.615334:0:17092:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787599595.615338:0:17092:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787599595.615984:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:18600:x1874433578029312:12345-0@lo:253:mount.lustre.0 Request processed in 805us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.615993:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599595.616277:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029312:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787599595.616292:0:18600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787599595.616295:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599595.616296:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787599595.616298:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599595.616300:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599595.616301:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599595.616302:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599595.616304:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599595.616306:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599595.616307:0:18600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787599595.616326:0:18600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b3440db800 from lustre-OST0000 10000000:01000000:0.0:1787599595.616376:0:18600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787599595.616378:0:18600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787599595.616386:0:18600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b370778000 local copy 00010000:00010000:0.0:1787599595.616396:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.616482:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599595.616509:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.616595:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029440 00000100:00100000:1.0:1787599595.616608:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029440 00000100:00100000:0.0:1787599595.616610:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599595.616684:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599595.616694:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:18600:x1874433578029440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599595.616779:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:18600:x1874433578029440:12345-0@lo:501:mount.lustre.0 Request processed in 87us (269us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599595.616786:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599595.616976:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029440:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787599595.616990:0:18600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787599595.617018:0:18600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787599595.617024:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.617033:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599595.617059:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b3440db800 10000000:01000000:0.0:1787599595.617064:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787599595.617068:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787599595.617070:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599595.617073:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787599595.617076:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599595.617097:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.617103:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.617109:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.617117:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599595.617137:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.617187:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.618266:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029568 00000100:00100000:3.0:1787599595.618276:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029568 00000100:00100000:3.0:1787599595.618376:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599595.618386:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+18:18600:x1874433578029568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599595.618399:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599595.618416:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d062b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0624 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.618461:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d062b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0624 expref: 19 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.618471:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d062b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0624 expref: 19 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.618481:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ce00, rc 0) 00000100:00100000:3.0:1787599595.618546:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029568:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.618552:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599595.618627:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599595.618643:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.618657:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599595.621022:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787599595.622645:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599595.626410:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787599595.626618:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787599595.626636:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787599595.626668:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787599595.626685:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787599595.626700:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787599595.626725:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787599595.626732:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787599595.627428:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599595.627710:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.627822:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599595.627947:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029696 00000100:00100000:1.0:1787599595.627955:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029696 00000100:00100000:1.0:1787599595.628020:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599595.628030:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599595.628385:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029696:12345-0@lo:501:mount.lustre.0 Request processed in 356us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.628393:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599595.628666:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599595.628706:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599595.628843:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.629077:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.629496:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029824 00000100:00100000:3.0:1787599595.629503:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029824 00000100:00100000:3.0:1787599595.629654:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599595.629665:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599595.630683:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029824:12345-0@lo:503:mount.lustre.0 Request processed in 1015us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.630695:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599595.630837:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787599595.631956:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599595.632086:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.632147:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.632395:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.632810:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578029952 00000100:00100000:3.0:1787599595.632817:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578029952 00000100:00100000:1.0:1787599595.632985:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787599595.633008:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599595.633786:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578029952:12345-0@lo:502:mount.lustre.0 Request processed in 789us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.633819:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599595.633992:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578029952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599595.634326:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787599595.634358:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787599595.634372:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787599595.634383:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787599595.634395:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787599595.634406:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787599595.634418:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787599595.634429:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787599595.634657:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787599595.634677:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787599595.634693:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787599595.634725:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787599595.634943:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.634994:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.635130:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b244066c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.635221:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030080 00000100:00100000:3.0:1787599595.635228:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030080 00000100:00100000:3.0:1787599595.635306:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787599595.635317:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578030080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599595.635415:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578030080:12345-0@lo:502:mount.lustre.0 Request processed in 100us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.635423:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599595.635617:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599595.635667:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787599595.635677:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787599595.636818:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599595.636829:0:18617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787599595.636837:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599595.636839:0:18617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787599595.636844:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599595.636982:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96b344afb370) 00000020:00000080:2.0:1787599595.637018:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787599595.637026:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599595.637097:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3440db800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787599595.637106:0:18617:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599595.637113:0:18617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929d0639 00010000:00010000:2.0:1787599595.654079:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787599595.654964:0:18617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787599595.659653:0:18617:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787599595.709446:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787599595.709456:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599595.709461:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709463:0:18617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787599595.709465:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599595.709467:0:18617:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787599595.709468:0:18617:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599595.709469:0:18617:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599595.709470:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599595.709482:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709483:0:18617:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599595.709485:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599595.709486:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709487:0:18617:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599595.709489:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599595.709490:0:18617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787599595.709491:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599595.709492:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709493:0:18617:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787599595.709494:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599595.709495:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709496:0:18617:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787599595.709498:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787599595.709523:0:18617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599595.709524:0:18617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599595.709526:0:18617:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787599595.709528:0:18617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787599595.709631:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787599595.709670:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787599595.709696:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.709709:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599595.709726:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3440db800 from 1 10000000:01000000:2.0:1787599595.709729:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599595.709767:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.709776:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.709788:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599595.709852:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599595.709922:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.709958:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.710042:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030208 00000100:00100000:3.0:1787599595.710050:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030208 00000100:00100000:3.0:1787599595.710105:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599595.710116:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:18600:x1874433578030208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599595.710131:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599595.710146:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0640 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.710170:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.710182:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.710192:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200d800, rc 0) 00000100:00100000:3.0:1787599595.710239:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030208:12345-0@lo:101:mount.lustre.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.710434:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599595.710449:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.710459:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599595.710921:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000040:00080000:0.0:1787599595.713478:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787599595.713779:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599595.714089:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787599595.714696:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787599595.714716:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787599595.714720:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787599595.714821:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599595.714950:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.714987:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.715267:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030336 00000100:00100000:2.0:1787599595.715276:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030336 00000100:00100000:2.0:1787599595.715323:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599595.715333:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599595.715458:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030336:12345-0@lo:501:mount.lustre.0 Request processed in 112us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.715466:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599595.718948:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599595.719025:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599595.719098:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.719137:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.719227:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030464 00000100:00100000:2.0:1787599595.719234:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030464 00000100:00100000:2.0:1787599595.719289:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599595.719300:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599595.719414:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030464:12345-0@lo:503:mount.lustre.0 Request processed in 115us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.719430:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599595.719432:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000040:00080000:0.0:1787599595.719740:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599595.719787:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599595.719862:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.719875:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599595.719935:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030592 00000100:00100000:1.0:1787599595.719940:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030592 00000100:00100000:1.0:1787599595.719971:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599595.719980:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599595.720092:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030592:12345-0@lo:502:mount.lustre.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.720100:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787599595.720215:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599595.720370:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787599595.720392:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787599595.720401:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787599595.720409:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787599595.720415:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787599595.720423:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787599595.720446:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787599595.720457:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787599595.720466:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787599595.720481:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787599595.720496:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787599595.720516:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599595.720551:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.720587:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.720650:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030720 00000100:00100000:2.0:1787599595.720655:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030720 00000100:00100000:2.0:1787599595.720689:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599595.720699:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.720780:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030720:12345-0@lo:502:mount.lustre.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.720786:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787599595.720789:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599595.720844:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787599595.720899:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787599595.722348:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599595.722357:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722359:0:18621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787599595.722364:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3440db800 00000020:00000080:3.0:1787599595.722365:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599595.722372:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599595.722373:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722374:0:18621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787599595.722376:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599595.722377:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722378:0:18621:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787599595.722380:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b3440db800 00000020:00000080:3.0:1787599595.722381:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599595.722432:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599595.722436:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722438:0:18621:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787599595.722441:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599595.722444:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722446:0:18621:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599595.722450:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3440db800 00000020:00000080:3.0:1787599595.722452:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599595.722467:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599595.722469:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722470:0:18621:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599595.722472:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599595.722474:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722475:0:18621:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787599595.722478:0:18621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b3440db800 00000020:00000080:3.0:1787599595.722479:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599595.722499:0:18621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599595.722501:0:18621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599595.722502:0:18621:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787599595.722504:0:18621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787599595.722845:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787599595.722877:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599595.722900:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.722912:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599595.723691:0:18600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787599595.723697:0:18600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b3440db800 10000000:01000000:1.0:1787599595.723701:0:18600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b3440db800 10000000:01000000:1.0:1787599595.723705:0:18600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599595.723954:0:18600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b3440db800 from 1 10000000:01000000:1.0:1787599595.723959:0:18600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599595.724835:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.724849:0:18600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.724861:0:18600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599595.724886:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599595.724958:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.725902:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030848 00000100:00100000:1.0:1787599595.725909:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344d57180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.725913:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030848 00000100:00100000:2.0:1787599595.725972:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599595.725983:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:18600:x1874433578030848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599595.726014:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599595.726030:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243758200/0x5d2988b0929d0655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d064e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.726059:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243758200/0x5d2988b0929d0655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d064e expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.726071:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243758200/0x5d2988b0929d0655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d064e expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599595.726081:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758200, rc 0) 00000100:00100000:2.0:1787599595.726141:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578030848:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.726149:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599595.726162:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599595.726180:0:18600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.726190:0:18600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599595.747860:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787599595.748175:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599595.748349:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787599595.748370:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787599595.748380:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787599595.748389:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787599595.748413:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787599595.748423:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787599595.748432:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787599595.748439:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787599595.748447:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787599595.748458:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787599595.748466:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787599595.748477:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787599595.748487:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787599595.748495:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787599595.748506:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787599595.748517:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787599595.748536:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787599595.748554:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787599595.748571:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787599595.748584:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787599595.748602:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787599595.748610:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787599595.748623:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787599595.748642:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787599595.748661:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787599595.748681:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787599595.748692:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787599595.748702:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787599595.748714:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787599595.748726:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787599595.748738:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787599595.748750:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787599595.748770:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787599595.748779:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787599595.748787:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787599595.748819:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787599595.748845:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787599595.748863:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787599595.748867:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787599595.748942:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599595.749024:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.749065:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.749269:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578030976 00000100:00100000:3.0:1787599595.749278:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578030976 00000100:00100000:3.0:1787599595.749343:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787599595.749353:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578030976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599595.749737:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578030976:12345-0@lo:501:mount.lustre.0 Request processed in 384us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.749745:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787599595.750519:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578030976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599595.750566:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599595.750607:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.750635:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.753352:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031104 00000100:00100000:3.0:1787599595.753368:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031104 00000100:00100000:3.0:1787599595.753435:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599595.753462:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599595.754360:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031104:12345-0@lo:503:mount.lustre.0 Request processed in 899us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.754372:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787599595.754498:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787599595.758203:0:18600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599595.758336:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.758429:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.758491:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599595.760314:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031232 00000100:00100000:0.0:1787599595.760330:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031232 00000100:00100000:0.0:1787599595.760396:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599595.760407:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599595.768727:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031232:12345-0@lo:502:mount.lustre.0 Request processed in 8310us (10286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.768742:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787599595.772401:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599595.772653:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787599595.772702:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787599595.772965:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787599595.772985:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787599595.773009:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787599595.773023:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787599595.773034:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787599595.773054:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787599595.773065:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787599595.773087:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787599595.773099:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787599595.773127:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787599595.773141:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787599595.773152:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787599595.773164:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787599595.773176:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787599595.773188:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787599595.773199:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787599595.773211:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787599595.773342:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787599595.773369:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787599595.773384:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787599595.773398:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787599595.773414:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787599595.773426:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787599595.773438:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787599595.773451:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787599595.773482:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787599595.773499:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787599595.773513:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787599595.773525:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787599595.773537:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787599595.773917:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787599595.773940:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787599595.773956:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787599595.773970:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787599595.773986:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787599595.774016:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787599595.774034:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787599595.774048:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787599595.774406:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787599595.774427:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787599595.774442:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787599595.774475:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787599595.774491:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787599595.774503:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787599595.774515:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787599595.774527:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787599595.775041:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.775378:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599595.775486:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599595.779435:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031360 00000100:00100000:3.0:1787599595.779452:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031360 00000100:00100000:3.0:1787599595.780649:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599595.780666:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599595.781009:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031360:12345-0@lo:502:mount.lustre.0 Request processed in 348us (5631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.781019:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599595.785661:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599595.785926:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787599595.785956:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787599595.786019:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599595.786414:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.786463:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599595.786509:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031488 00000100:00100000:2.0:1787599595.786518:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031488 00000100:00100000:2.0:1787599595.786591:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787599595.786603:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599595.786760:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578031488:12345-0@lo:502:mount.lustre.0 Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.786768:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599595.787337:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578031488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599595.787406:0:18600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787599595.787417:0:18600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787599595.789234:0:18627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787599595.789250:0:18627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96b344afcd28) 00000020:00000080:2.0:1787599595.789273:0:18627:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787599595.789368:0:18627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3440db800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599595.789371:0:18627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3440db800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599595.789374:0:18627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3440db800 3 00010000:00080000:2.0:1787599595.789403:0:18627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3434d6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599595.797442:0:18627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787599595.797648:0:18627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787599595.797704:0:18627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599595.797717:0:18627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d2988b0929d0663 00000100:00080000:3.0:1787599595.797728:0:18627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599595.797734:0:18627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b3434d6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599595.797767:0:18627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405e680 x1874433578031616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599595.798670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578031616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599595.798932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599595.798993:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031616 00000100:00100000:3.0:1787599595.799011:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031616 00000100:00100000:3.0:1787599595.799041:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599595.799048:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578031616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787599595.799653:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1787599595.799759:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d2988b0929d066a 00000004:00100000:3.0:1787599595.799778:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599595.800185:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b36571c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599595.800752:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874433578031616:12345-0@lo:38:llog_process_th.0 Request processed in 1700us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.800763:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787599595.800953:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b24405e680 x1874433578031616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599595.800965:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599595.800973:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787599595.800980:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787599595.800984:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599595.800987:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599595.800992:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578031616:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787599595.801025:0:18627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1787599595.802071:0:18627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787599595.802091:0:18627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96b37f8999b8) 00000020:00000080:3.0:1787599595.802116:0:18627:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787599595.802196:0:18627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b3440db800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787599595.802199:0:18627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3440db800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787599595.802202:0:18627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3440db800 3 00010000:00080000:3.0:1787599595.802487:0:18627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b365719800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1787599595.809323:0:18627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00080000:2.0:1787599595.811607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.811614:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.811616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.811626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.811651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.811654:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.811657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.811659:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599595.815080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578031744:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.815174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.815251:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599595.815259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578031872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.815300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.815349:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578032000:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.815373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.815391:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599595.815397:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578032128:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.815418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.815489:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031872 00000100:00100000:1.0:1787599595.815498:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031872 00000020:00000080:0.0:1787599595.816066:0:18627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787599595.816195:0:18627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599595.816215:0:18627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5d2988b0929d0678 00000100:00080000:0.0:1787599595.816234:0:18627:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599595.816240:0:18627:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff96b365719800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599595.816283:0:18627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138e300 x1874433578032256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599595.816309:0:18627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787599595.817180:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578031744 00000100:00100000:2.0:1787599595.817191:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578031744 00000100:00100000:2.0:1787599595.817239:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032000 00000100:00100000:2.0:1787599595.817242:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032000 00000100:00100000:2.0:1787599595.817260:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599595.817429:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578031744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599595.817533:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578031744:12345-0@lo:400:kworker.0 Request processed in 264us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.817541:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599595.817772:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599595.817781:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578032000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599595.818128:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578032000:12345-0@lo:400:kworker.0 Request processed in 348us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599595.818135:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787599595.818165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.818170:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.818173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.818176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.818180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.818196:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599595.818199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599595.818202:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787599595.820140:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578032256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599595.820229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.820423:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032128 00000100:00100000:1.0:1787599595.820432:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032128 00000100:00100000:1.0:1787599595.820494:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599595.820505:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578031872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.820582:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578031872:12345-0@lo:400:kworker.0 Request processed in 79us (5282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.820590:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599595.820760:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599595.820770:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578032128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599595.821057:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578032128:12345-0@lo:400:kworker.0 Request processed in 289us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.821064:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599595.822147:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032256 00000100:00100000:0.0:1787599595.822157:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032256 00000100:00100000:0.0:1787599595.822193:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599595.822200:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578032256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787599595.822245:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00010000:00080000:1.0:1787599595.822615:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b370012300 x1874433578031872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599595.822633:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578031872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.822651:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578031744:0@lo:400:kworker.0 00010000:00080000:1.0:1787599595.822702:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b370011f80 x1874433578032128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599595.822712:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578032128:0@lo:400:kworker.0 00000100:00100000:1.0:1787599595.822723:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578032000:0@lo:400:kworker.0 00000020:00000080:0.0:1787599595.823184:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5d2988b0929d067f 00000004:00100000:0.0:1787599595.823211:0:17099:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599595.825691:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b244115000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599595.826451:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874433578032256:12345-0@lo:38:llog_process_th.0 Request processed in 4243us (6216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.826464:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787599595.827380:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b38138e300 x1874433578032256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599595.827398:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599595.827408:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787599595.827427:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787599595.827432:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787599595.827437:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b365719800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787599595.827445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578032256:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787599595.829622:0:18627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787599595.831366:0:18600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787599595.831415:0:18600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787599595.831433:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.831447:0:18600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787599595.831504:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787599595.831506:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787599595.831508:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599595.831509:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599595.831510:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599595.831512:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599595.831513:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599595.831515:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599595.831516:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787599595.831520:0:18600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787599595.831522:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787599595.831523:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787599595.831524:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599595.831525:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599595.831527:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599595.831528:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599595.831529:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599595.831530:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599595.831531:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787599595.831559:0:18600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787599595.831580:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578032384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787599595.831653:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.831691:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599595.838395:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032384 00000100:00100000:0.0:1787599595.838409:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032384 00000100:00100000:0.0:1787599595.838476:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599595.838487:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578032384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599595.838519:0:17090:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787599595.838534:0:17090:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787599595.848194:0:17090:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787599595.848217:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787599595.849424:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:18600:x1874433578032384:12345-0@lo:253:mount.lustre.0 Request processed in 10930us (17763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.849439:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787599595.849546:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:18600:1874433578032384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599595.849575:0:18600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787599595.849579:0:18600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599595.849581:0:18600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599595.849582:0:18600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599595.849583:0:18600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599595.849594:0:18600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599595.849596:0:18600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599595.849598:0:18600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599595.849600:0:18600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599595.849601:0:18600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599595.849616:0:18600:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787599595.849687:0:17113:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787599595.849693:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787599595.849718:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849733:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849740:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849747:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849781:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849814:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 20 pid: 17092 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599595.849828:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578032512:0@lo:104: 00000100:00100000:1.0:1787599595.849864:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599595.849971:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.849979:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 20 pid: 17091 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599595.849988:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578032640:0@lo:104: 00000100:00100000:1.0:1787599595.850022:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599595.850038:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599595.850058:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787599595.850569:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032512 00000100:00100000:1.0:1787599595.850582:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032512 00000100:00100000:1.0:1787599595.850612:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032640 00000100:00100000:1.0:1787599595.850615:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032640 00000100:00100000:1.0:1787599595.850626:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599595.850634:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578032512:12345-0@lo:104: 00010000:00010000:1.0:1787599595.850645:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.850693:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599595.850698:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578032512:12345-0@lo:104: Request processed in 66us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.850704:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599595.850718:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599595.850723:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578032640:12345-0@lo:104: 00010000:00010000:1.0:1787599595.850729:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.850757:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599595.850761:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578032640:12345-0@lo:104: Request processed in 39us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599595.850766:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787599595.850819:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599595.850825:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.850832:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599595.850836:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.850855:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599595.850861:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599595.850866:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599595.851595:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851604:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599595.851634:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851641:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d05d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05de expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851655:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599595.851658:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851664:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b34152a200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599595.851667:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851675:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599595.851680:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.851688:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578032768:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1787599595.851700:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599595.851717:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851722:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599595.851729:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599595.851736:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152a200/0x5d2988b0929d05c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05d0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.851739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599595.851757:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599595.851759:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599595.851762:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599595.851770:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599595.851817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578032896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599595.852762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599595.860254:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032768 00000100:00100000:0.0:1787599595.860266:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032768 00010000:00010000:0.0:1787599595.860307:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 21 pid: 17092 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.860340:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578032896 00000100:00100000:0.0:1787599595.860343:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578032896 00010000:00010000:0.0:1787599595.860354:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 22 pid: 17091 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.860378:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599595.860388:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3645:x1874433578032768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599595.860411:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599595.860417:0:17853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 22 pid: 17092 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.860430:0:17853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 22 pid: 17092 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.860468:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599595.861362:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599595.861374:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3646:x1874433578032896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599595.861387:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599595.861395:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 22 pid: 17091 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861407:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 22 pid: 17091 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861422:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861430:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599595.861446:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018659547s 00010000:00010000:3.0:1787599595.861450:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861457:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861463:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861468:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861485:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ac00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599595.861490:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861498:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861507:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599595.861518:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599595.861915:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3646:x1874433578032896:12345-0@lo:103:ldlm_bl.0 Request processed in 541us (9152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599595.861923:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599595.863762:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578032768:12345-0@lo:103:ldlm_bl.0 Request processed in 3369us (12018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599595.863777:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599595.864537:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578032768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599595.865082:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759400/0x5d2988b0929d05de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d05d7 expref: 20 pid: 17092 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.865098:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578032512:0@lo:104: 00010000:00010000:0.0:1787599595.865109:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e4c00/0x5d2988b0929d05d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d05c9 expref: 19 pid: 17091 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599595.865116:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578032640:0@lo:104: 00010000:00010000:0.0:1787599595.865135:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.865144:0:17113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.865149:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599595.865155:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d0686 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787599595.871639:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787599595.874278:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578032896:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1787599595.878362:0:18600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787599595.878372:0:18600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787599595.878412:0:18600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787599595.878473:0:18600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787599595.878501:0:18600:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787599595.878520:0:18600:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787599595.879391:0:18600:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599595.879610:0:18600:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599596.007069:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787599596.597120:0:18681:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599596.597775:0:18681:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599597.028964:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787599597.548405:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599597.548416:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f890800 from 9 10000000:01000000:0.0:1787599597.548422:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599597.548694:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599597.548707:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599597.548720:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599597.548747:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599597.549897:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599597.549961:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787599597.553302:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033024 00000100:00100000:3.0:1787599597.553318:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033024 00000100:00100000:3.0:1787599597.553393:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787599597.553405:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:17094:x1874433578033024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599597.553422:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599597.553445:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d068d expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599597.553477:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d068d expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599597.553488:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d068d expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599597.553683:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599597.553860:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:17094:x1874433578033024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 457us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599597.553867:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787599597.560914:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599597.561893:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599597.561909:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599597.562129:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599597.562478:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599597.564726:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599597.572681:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033152 00000100:00100000:0.0:1787599597.572697:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033152 00000100:00100000:0.0:1787599597.572765:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787599597.572777:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:17094:x1874433578033152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787599597.572865:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599597.572888:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599597.572892:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787599597.573730:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:17094:x1874433578033152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 951us (11248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599597.573741:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787599597.573884:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787599597.573962:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599597.573973:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599597.573992:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599597.574004:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599597.574006:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b377a86000 from 9 10000000:01000000:2.0:1787599597.574009:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599597.574038:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599597.574045:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599597.574140:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599597.574162:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599597.574196:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599597.574235:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344ba13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599597.574378:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033280 00000100:00100000:0.0:1787599597.574384:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033280 00000100:00100000:0.0:1787599597.574477:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787599597.574487:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:17094:x1874433578033280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599597.574498:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599597.574512:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d069b expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599597.574534:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d069b expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599597.574544:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d069b expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599597.574553:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4400, rc 0) 00000100:00100000:0.0:1787599597.574591:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578033280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599597.574598:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787599597.574625:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599597.574639:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599597.574647:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599597.574689:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599597.574713:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599597.574730:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599597.574769:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033408 00000100:00100000:3.0:1787599597.574773:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033408 00000100:00100000:2.0:1787599597.574846:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599597.574855:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578033408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787599597.574868:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599597.574883:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599597.574886:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787599597.574967:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578033408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599597.574975:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599597.575010:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578033408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787599597.575050:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599597.575056:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599597.575064:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599597.605820:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599597.605849:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578033536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599597.609887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599597.609946:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033536 00000100:00100000:2.0:1787599597.609960:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033536 00000100:00100000:2.0:1787599597.610044:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599597.610057:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578033536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599597.610108:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787599597.610249:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578033536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 195us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599597.610257:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599597.610895:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578033536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787599598.054152:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599598.117217:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599598.117247:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578033664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599598.117332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599598.117438:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033664 00000100:00100000:3.0:1787599598.117447:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033664 00000100:00100000:3.0:1787599598.117513:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599598.117523:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578033664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599598.117565:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599598.117616:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578033664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599598.117622:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599598.117680:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578033664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599599.077220:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599599.783889:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599600.110846:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599601.134245:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599601.189056:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599601.189066:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599601.189069:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599601.189073:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599601.189106:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599601.189110:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599601.189112:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599601.189126:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787599601.189189:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578033920:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578034432:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189406:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599601.189413:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578033792:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189465:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578034304:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189517:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578034048:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189556:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578034560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599601.189599:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578034176:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599601.189650:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033920 00000100:00100000:2.0:1787599601.189658:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033920 00000100:00100000:2.0:1787599601.189692:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034176 00000100:00100000:2.0:1787599601.189695:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034176 00000100:00100000:2.0:1787599601.189711:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599601.189720:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578033920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189782:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578033920:12345-0@lo:400:kworker.0 Request processed in 62us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.189824:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599601.189845:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787599601.189852:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578034176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.189885:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578034176:12345-0@lo:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.189890:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787599601.189909:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034432 00000100:00100000:2.0:1787599601.189913:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034432 00000100:00100000:2.0:1787599601.189940:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034304 00000100:00100000:2.0:1787599601.189943:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034304 00000100:00100000:2.0:1787599601.189966:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034048 00000100:00100000:2.0:1787599601.189969:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034048 00000100:00100000:2.0:1787599601.189978:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034560 00000100:00100000:2.0:1787599601.189980:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034560 00000100:00100000:2.0:1787599601.189993:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599601.189999:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578034432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190029:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578034432:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.190035:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599601.190046:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599601.190051:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578034304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190075:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578034304:12345-0@lo:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.190080:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599601.190091:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599601.190096:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190131:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578034048:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.190137:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599601.190149:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599601.190155:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578034560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190180:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578034560:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.190186:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599601.190202:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578033792 00000100:00100000:2.0:1787599601.190206:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578033792 00000100:00100000:2.0:1787599601.190234:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599601.190240:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3646:x1874433578033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190268:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3646:x1874433578033792:12345-0@lo:400:kworker.0 Request processed in 29us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599601.190274:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787599601.190326:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599601.190331:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599601.190361:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578034176:0@lo:400:kworker.0 00010000:00080000:2.0:1787599601.190374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370011880 x1874433578034048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599601.190384:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578034048:0@lo:400:kworker.0 00010000:00080000:2.0:1787599601.190394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370013100 x1874433578034560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599601.190402:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578034560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190441:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578033792:0@lo:400:kworker.0 00010000:00080000:2.0:1787599601.190451:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370011c00 x1874433578034304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599601.190459:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578034304:0@lo:400:kworker.0 00000100:00100000:2.0:1787599601.190467:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578033920:0@lo:400:kworker.0 00010000:00080000:2.0:1787599601.190477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370010a80 x1874433578034432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599601.190492:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578034432:0@lo:400:kworker.0 00010000:00010000:1.0:1787599602.166992:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599602.426471:0:18970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787599602.740001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578034688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599602.740099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599602.747691:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034688 00000100:00100000:3.0:1787599602.747708:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034688 00000100:00100000:3.0:1787599602.747780:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599602.747831:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578034688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599602.747869:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787599602.747966:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578034688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (7867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599602.747987:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599602.748043:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578034688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599602.991492:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599587/real 1787599587] req@ffff96b2440efb80 x1874433578027392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599602.991530:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2440efb80 x1874433578027392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599602.991539:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599587/real 1787599587] req@ffff96b2440ee680 x1874433578027520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599602.991550:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2440ee680 x1874433578027520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787599602.991572:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599602.991592:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787599602.991597:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578027392:0@lo:8:kworker.0 00000100:00080000:3.0:1787599602.991602:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599602.991607:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787599602.991610:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578027520:0@lo:8:kworker.0 00000100:00080000:3.0:1787599602.991696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599602.991699:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599602.991702:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599602.991705:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599602.991722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599602.991734:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787599602.991737:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599602.991741:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:3.0:1787599602.991747:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599602.991756:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b34631c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599602.991778:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405c000 x1874433578035200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599602.991817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599602.991821:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599602.991823:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599602.991826:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:3.0:1787599602.991829:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599602.991832:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599602.991844:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405fb80 x1874433578035328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599602.991845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578034944:0@lo:400:kworker.0 00000100:00100000:3.0:1787599602.991897:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578034816:0@lo:400:kworker.0 00000100:00100000:2.0:1787599602.991929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599602.991943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599602.997231:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034816 00000100:00100000:0.0:1787599602.997250:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034816 00000100:00100000:0.0:1787599602.997325:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787599602.997349:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578034816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.003567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578035584:0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.003633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.003680:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599603.003690:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578035712:0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.003719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.003757:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578035456:0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.003781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.003838:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599603.003845:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578035072:0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.003988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.004020:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035584 00000100:00100000:3.0:1787599603.004033:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035584 00000100:00100000:3.0:1787599603.004078:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035712 00000100:00100000:3.0:1787599603.004080:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035712 00000100:00100000:3.0:1787599603.004093:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035456 00000100:00100000:3.0:1787599603.004095:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035456 00000100:00100000:3.0:1787599603.004105:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035072 00000100:00100000:3.0:1787599603.004107:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035072 00000100:00100000:3.0:1787599603.004122:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599603.004131:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578035584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.004332:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578035584:12345-0@lo:400:kworker.0 Request processed in 201us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.004340:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599603.004359:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599603.004365:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578035712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.004393:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578035712:12345-0@lo:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.004399:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599603.004411:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599603.004416:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578035456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.005053:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578035456:12345-0@lo:400:kworker.0 Request processed in 637us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.005060:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599603.005078:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599603.005086:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.005122:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578035072:12345-0@lo:400:kworker.0 Request processed in 37us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.005128:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599603.005177:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578035200:0@lo:8:kworker.0 00010000:00080000:1.0:1787599603.005721:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405dc00 x1874433578035072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599603.005736:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578035072:0@lo:400:kworker.0 00010000:00080000:1.0:1787599603.005749:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405ca80 x1874433578035456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599603.005758:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578035456:0@lo:400:kworker.0 00000100:00100000:1.0:1787599603.005838:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578034944 00000100:00100000:1.0:1787599603.005844:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578034944 00000100:00100000:1.0:1787599603.005901:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599603.005910:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578034944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599603.005974:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578034944:12345-0@lo:400:kworker.0 Request processed in 66us (14045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599603.005981:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599603.006415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.006647:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578035328:0@lo:8:kworker.0 00000100:00100000:3.0:1787599603.006673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.006723:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035200 00000100:00100000:3.0:1787599603.006729:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035200 00000100:00100000:3.0:1787599603.006747:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035328 00000100:00100000:3.0:1787599603.006750:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035328 00000100:00100000:3.0:1787599603.006761:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599603.006766:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578035200:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787599603.006828:0:18605:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1787599603.008546:0:18605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d06a9 00002000:00100000:3.0:1787599603.008575:0:18605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff96b36571f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787599603.008581:0:18605:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787599603.008583:0:18605:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787599603.009609:0:18605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787599603.009644:0:18605:0:(import.c:65:import_set_state_nolock()) ffff96b36571e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599603.009690:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578034944:0@lo:400:kworker.0 00000100:00100000:3.0:1787599603.009735:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578035200:12345-0@lo:8:kworker.0 Request processed in 2966us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.009745:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599603.009775:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599603.009782:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578035328:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787599603.009830:0:18605:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787599603.009988:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b351769f80 x1874433578035712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599603.010001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578035712:0@lo:400:kworker.0 00010000:00080000:2.0:1787599603.010014:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b351768000 x1874433578035584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599603.010023:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578035584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599603.010433:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578034816:12345-0@lo:400:kworker.0 Request processed in 13085us (18497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599603.010442:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787599603.010558:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578034816:0@lo:400:kworker.0 00010000:00080000:0.0:1787599603.010913:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405c000 x1874433578035200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599603.010923:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599603.010941:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787599603.010951:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787599603.010957:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787599603.010960:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787599603.010980:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787599603.010986:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578035200:0@lo:8:kworker.0 00000004:00080000:1.0:1787599603.011132:0:17839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787599603.011155:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578035968:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787599603.011198:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599603.011223:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599603.011228:0:18606:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787599603.011239:0:18606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:1.0:1787599603.011239:0:17838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599603.011315:0:17838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 549630521472ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787599603.011322:0:17838:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787599603.011343:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599603.011352:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578035840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599603.011379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599603.015411:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035968 00000100:00100000:0.0:1787599603.015604:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035968 00000100:00100000:0.0:1787599603.015684:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599603.015696:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17839:x1874433578035968:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1787599603.015955:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787599603.021538:0:17830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787599603.022000:0:18606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787599603.022008:0:18606:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787599603.022507:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17839:x1874433578035968:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6809us (11303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599603.022518:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599603.033332:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440ef100 x1874433578035968/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599603.033353:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578035968:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787599603.033367:0:17839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787599603.039052:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578035328:12345-0@lo:8:kworker.0 Request processed in 29260us (32368us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599603.039067:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787599603.039128:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599603.039134:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599603.039138:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578035328:0@lo:8:kworker.0 00000100:00100000:3.0:1787599603.039181:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578035840 00000100:00100000:3.0:1787599603.039187:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578035840 00000100:00100000:3.0:1787599603.039226:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599603.039238:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874433578035840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599603.039268:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599603.039310:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874433578035840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (27930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599603.039316:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787599603.039350:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440eea00 x1874433578035840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599603.039369:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578035840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599603.041279:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578036096:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787599603.041334:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.041364:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599603.042863:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036096 00000100:00100000:2.0:1787599603.042873:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036096 00000100:00100000:2.0:1787599603.042946:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599603.042957:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17839:x1874433578036096:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787599603.042987:0:18992:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787599603.043078:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17839:x1874433578036096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 123us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599603.043086:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787599603.043273:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b35176ad80 x1874433578036096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599603.043288:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578036096:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787599603.043300:0:17839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787599603.043346:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578036224:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787599603.043377:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599603.043405:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599603.044042:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036224 00000100:00100000:3.0:1787599603.044049:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036224 00000100:00100000:3.0:1787599603.044080:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599603.044088:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17839:x1874433578036224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787599603.044126:0:18604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1787599603.080745:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787599603.080762:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787599603.081091:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17839:x1874433578036224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36997us (37707us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787599603.081113:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787599603.081527:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138f800 x1874433578036224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599619 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599603.081542:0:17839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787599603.081551:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17839:1874433578036224:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787599603.081572:0:17839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787599603.081625:0:17839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1874433578036352:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787599603.081662:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599603.081736:0:17839:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2422dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599603.081824:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036352 00000100:00100000:2.0:1787599603.081832:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036352 00000100:00100000:2.0:1787599603.081912:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599603.081923:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1874433578036352:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787599603.081994:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1874433578036352:12345-0@lo:900:osp-pre-0-1.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599603.082001:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599603.082055:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b351769c00 x1874433578036352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599619 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599603.082066:0:17839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1874433578036352:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787599603.186230:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599603.237295:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578036480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599603.237380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599603.237440:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036480 00000100:00100000:0.0:1787599603.237458:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036480 00000100:00100000:0.0:1787599603.237503:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599603.237512:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578036480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599603.237547:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787599603.237591:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578036480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599603.237599:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599603.237649:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578036480:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787599603.750458:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1787599603.797589:0:19024:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599603.799207:0:19024:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787599604.202610:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787599605.139624:0:19074:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599605.140528:0:19074:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599605.227752:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599606.244949:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599607.079933:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599587/real 1787599587] req@ffff96b2440ee300 x1874433578027136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599607 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599607.079969:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2440ee300 x1874433578027136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599607 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599607.079980:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599587/real 1787599587] req@ffff96b2440ec700 x1874433578027264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599607 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599607.080009:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2440ec700 x1874433578027264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599607 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787599607.080032:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787599607.080069:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787599607.080075:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578027136:0@lo:8:kworker.0 00000100:00080000:0.0:1787599607.080082:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787599607.080088:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787599607.080091:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578027264:0@lo:8:kworker.0 00000100:00100000:2.0:1787599607.080585:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578036608:0@lo:400:kworker.0 00000100:00100000:2.0:1787599607.080707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599607.081740:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036608 00000100:00100000:0.0:1787599607.081754:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036608 00000100:00100000:0.0:1787599607.081829:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787599607.081841:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578036608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787599607.083756:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599607.083766:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787599607.083770:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599607.083779:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1787599607.083784:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787599607.083813:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b244394800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599607.083848:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440ed180 x1874433578036864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599607.083872:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599607.083876:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599607.083877:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599607.083881:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1787599607.083884:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787599607.083888:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599607.083909:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440ed500 x1874433578036992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599607.083953:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599607.083964:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599607.083966:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599607.083970:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1787599607.083973:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787599607.083977:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599607.083988:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24405fb80 x1874433578037504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599607.084163:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578036736:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084293:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578037632:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084339:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599607.084344:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578037376:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084394:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578037120:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084444:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578037760:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084486:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599607.084491:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578037248:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084544:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578037888:0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.084592:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037632 00000100:00100000:1.0:1787599607.084598:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037632 00000100:00100000:1.0:1787599607.084635:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037120 00000100:00100000:1.0:1787599607.084638:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037120 00000100:00100000:1.0:1787599607.084648:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037760 00000100:00100000:1.0:1787599607.084650:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037760 00000100:00100000:1.0:1787599607.084670:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037888 00000100:00100000:1.0:1787599607.084673:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037888 00000100:00100000:1.0:1787599607.084687:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599607.084695:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578037632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084748:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578037632:12345-0@lo:400:kworker.0 Request processed in 53us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599607.084754:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599607.084771:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599607.084776:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084832:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578037120:12345-0@lo:400:kworker.0 Request processed in 55us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599607.084838:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599607.084849:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599607.084855:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578037760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084881:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578037760:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599607.084885:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599607.084908:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599607.084915:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599607.084941:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578037888:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599607.084946:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787599607.084970:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599607.084980:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787599607.085004:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405c000 x1874433578037632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.085017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578037632:0@lo:400:kworker.0 00010000:00080000:1.0:1787599607.085043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405c380 x1874433578037888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.085052:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578037888:0@lo:400:kworker.0 00010000:00080000:1.0:1787599607.085196:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440ec700 x1874433578037120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.085207:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578037120:0@lo:400:kworker.0 00010000:00080000:1.0:1787599607.085221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24405e680 x1874433578037760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.085228:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578037760:0@lo:400:kworker.0 00000100:00100000:3.0:1787599607.085371:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578036864:0@lo:8:kworker.0 00000100:00100000:3.0:1787599607.085405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599607.085447:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578036992:0@lo:8:kworker.0 00000100:00100000:3.0:1787599607.085474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599607.085491:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578037504:0@lo:8:kworker.0 00000100:00100000:3.0:1787599607.085510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599607.085539:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037376 00000100:00100000:3.0:1787599607.085549:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037376 00000100:00100000:3.0:1787599607.085578:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036864 00000100:00100000:3.0:1787599607.085582:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036864 00000100:00100000:3.0:1787599607.085590:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036992 00000100:00100000:3.0:1787599607.085592:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036992 00000100:00100000:3.0:1787599607.085599:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037504 00000100:00100000:3.0:1787599607.085601:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037504 00000100:00100000:3.0:1787599607.085610:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599607.085618:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578037376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599607.085655:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578037376:12345-0@lo:400:kworker.0 Request processed in 38us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599607.085661:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599607.085673:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599607.085678:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1874433578036864:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787599607.085701:0:18606:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1787599607.085734:0:18606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d06b0 00002000:00100000:3.0:1787599607.085748:0:18606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96b37b7a3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787599607.085752:0:18606:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787599607.085754:0:18606:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787599607.085870:0:18606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787599607.085892:0:18606:0:(import.c:65:import_set_state_nolock()) ffff96b37b7a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599607.085942:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578036864:12345-0@lo:8:kworker.0 Request processed in 261us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599607.085948:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599607.085961:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599607.085966:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1874433578036992:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787599607.085977:0:18606:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787599607.087340:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599607.087389:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440eea00 x1874433578037376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.087404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578037376:0@lo:400:kworker.0 00000100:00100000:0.0:1787599607.088007:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578036608:12345-0@lo:400:kworker.0 Request processed in 6164us (7295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599607.088019:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787599607.088117:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578036736 00000100:00100000:0.0:1787599607.088124:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578036736 00000100:00100000:0.0:1787599607.088152:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578037248 00000100:00100000:0.0:1787599607.088155:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578037248 00000100:00100000:0.0:1787599607.088167:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599607.088175:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599607.088265:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578036736:12345-0@lo:400:kworker.0 Request processed in 90us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599607.088271:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599607.088295:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599607.088301:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578037248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599607.088341:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578037248:12345-0@lo:400:kworker.0 Request processed in 40us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599607.088347:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599607.088371:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599607.088377:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578037504:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787599607.088530:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578036736:0@lo:400:kworker.0 00000100:00100000:2.0:1787599607.088622:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578036608:0@lo:400:kworker.0 00010000:00020000:0.0:1787599607.088780:0:18605:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599607.089025:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578037504:12345-0@lo:8:kworker.0 Request processed in 646us (3512us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599607.089032:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599607.089496:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578037248:0@lo:400:kworker.0 00010000:00080000:2.0:1787599607.091005:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440ed180 x1874433578036864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599607.091023:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599607.091035:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787599607.091046:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787599607.091054:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787599607.091058:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787599607.091093:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787599607.091111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578036864:0@lo:8:kworker.0 00000100:00080000:2.0:1787599607.091149:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599607.091155:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599607.091159:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578037504:0@lo:8:kworker.0 00000004:00080000:2.0:1787599607.091192:0:17121:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787599607.091302:0:17121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 553710508750ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787599607.091310:0:17121:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787599607.095334:0:17122:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787599607.095363:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17122:1874433578038144:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787599607.095446:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.095476:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599607.095918:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599607.095939:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578038016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599607.095972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.096021:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038144 00000100:00100000:1.0:1787599607.096029:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038144 00000100:00100000:2.0:1787599607.096148:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038016 00000100:00100000:2.0:1787599607.096154:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038016 00000100:00100000:1.0:1787599607.096211:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599607.096221:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17122:x1874433578038144:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787599607.096410:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787599607.097831:0:18992:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787599607.097841:0:18992:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787599607.097846:0:18992:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1787599607.107732:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599607.107752:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433578038016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599607.107804:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599607.107915:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433578038016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (11942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599607.107923:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787599607.112561:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377afdc00 x1874433578038016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599607.112589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578038016:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1787599607.113651:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.113662:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113679:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.113683:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.113690:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113707:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113718:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113740:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113756:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599607.113766:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.113770:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113775:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54bc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.113778:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113785:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113815:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113820:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027503b56/0x5d2988b0929d06b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.113835:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.113837:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.113838:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787599607.114288:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787599607.114357:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.114364:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.114372:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.114375:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.114379:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.114389:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.114397:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.114405:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115149:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599607.115542:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.115551:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115562:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.115566:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.115570:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115594:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115603:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115611:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115627:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787599607.115639:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599607.115645:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115653:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.115657:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115666:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115680:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115688:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa2335f3/0x5d2988b0929d06be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115711:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.115715:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115722:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.115725:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115732:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115743:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115751:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb96792/0x5d2988b0929d06c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.115762:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.115763:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.115765:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599607.117619:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.117634:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117651:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.117669:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.117675:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117689:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117700:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117707:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117730:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599607.117747:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.117753:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117760:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.117766:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117774:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117805:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117823:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b981cc3d/0x5d2988b0929d06cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.117841:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.117843:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.117845:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599607.120271:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.120286:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.120303:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.120309:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.120316:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.120330:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.120339:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.120347:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.120371:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599607.120388:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.120406:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.120836:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.121116:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.121124:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.121135:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.121155:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.121162:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d06d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.121184:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.121186:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.121188:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599607.123991:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.124006:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.124023:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.124027:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.124034:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.124130:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.124142:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.124149:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.124213:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599607.126330:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1874433578036992:12345-0@lo:8:kworker.0 Request processed in 40352us (40845us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599607.126344:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787599607.126401:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599607.126406:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599607.126410:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578036992:0@lo:8:kworker.0 00002000:00010000:1.0:1787599607.126914:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.126926:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.126944:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.126949:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.126956:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.126970:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.126980:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.127003:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133573:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599607.133591:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133608:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.133613:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133626:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133684:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133693:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be92e36b/0x5d2988b0929d06da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133724:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.133729:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133736:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.133739:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133746:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133756:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.133764:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.133766:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.133768:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.133893:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787599607.133911:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bcbdee/0x5d2988b0929d06e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.134155:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599607.134655:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.134665:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.134678:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.134682:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.134689:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.134702:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.134710:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.134718:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.134788:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599607.135153:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599607.135159:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.135167:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=553s v=(0 0) 00010000:00010000:1.0:1787599607.135170:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599607.135174:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.135183:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.135189:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.135196:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138541:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599607.138558:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138592:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54be00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.138598:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138610:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138634:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138642:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002943eec5/0x5d2988b0929d06e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138673:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.138678:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138685:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.138689:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138696:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138706:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.138721:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.138723:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.138725:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.140652:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787599607.140673:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a51e2f7/0x5d2988b0929d06ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.141437:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.141638:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.141648:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.141663:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.141667:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.141674:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.141688:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.141697:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.141718:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.141744:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599607.142067:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599607.142079:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.142088:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.142093:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.142102:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.142121:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.142128:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089910469/0x5d2988b0929d06f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.142147:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.142149:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.142151:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.142410:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.142425:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.142434:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.142437:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.142441:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.142450:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.142458:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.142465:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.142486:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599607.142894:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.142911:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.142920:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.142924:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.142932:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.142945:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.142952:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1554a81/0x5d2988b0929d06fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.142967:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.142969:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.142971:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.143179:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.143186:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143203:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.143206:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.143212:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143222:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143230:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143238:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143256:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787599607.143695:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.143702:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143711:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.143714:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.143718:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143727:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143745:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143752:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.143773:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599607.143888:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599607.143905:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143914:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.143918:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143927:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143941:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143948:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d67cac/0x5d2988b0929d0704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143963:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599607.143966:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143972:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.143975:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.143982:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.144005:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.144012:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094144dff/0x5d2988b0929d070b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.144024:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.144025:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.144027:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.144093:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.144510:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.144518:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.144527:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.144530:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.144535:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.144544:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.144553:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.144560:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.144623:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787599607.145684:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.145694:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.145706:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.145709:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.145714:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.145724:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.145732:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.145740:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146176:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599607.146185:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146194:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.146199:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146207:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146223:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146231:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7248807/0x5d2988b0929d0712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146267:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599607.146270:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146276:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.146279:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146285:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146294:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.146302:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.146304:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.146306:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.149850:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.149868:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514f2ad3/0x5d2988b0929d0719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.150405:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.155112:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.155133:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.155162:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.155168:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.155175:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.155191:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.155202:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.155212:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.155241:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599607.155510:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.155518:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.155527:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.155533:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.155543:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.155562:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.155571:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4eb2c9f/0x5d2988b0929d0720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.155590:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.155592:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.155593:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.156526:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.156537:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.156549:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.156554:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.156559:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.156570:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.156597:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.156606:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.156633:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599607.157040:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.157049:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.157058:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.157073:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.157094:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.157110:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.157118:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3f9c4fa/0x5d2988b0929d0727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.157136:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.157138:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.157140:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.158439:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.158451:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.158465:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.158469:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.158475:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.158487:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.158496:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.158504:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.158544:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599607.158913:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.158921:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.158930:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.158935:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.158945:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.158961:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.158979:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d6d369/0x5d2988b0929d072e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.159004:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.159006:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.159008:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.159226:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.159232:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159242:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.159245:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.159250:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159260:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159268:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159275:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159297:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787599607.159566:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.159572:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159581:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.159589:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.159594:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159605:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159613:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.159620:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.162949:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787599607.165006:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.165020:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.165039:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.165044:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.165051:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.165078:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.165089:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.165110:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165234:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599607.165243:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165258:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.165262:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165270:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165288:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165295:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008734daf1/0x5d2988b0929d0735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165318:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599607.165323:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165329:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.165333:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165340:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165348:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165362:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a452b950/0x5d2988b0929d073c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165376:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.165379:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165386:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.165390:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165397:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165407:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.165414:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.165415:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.165417:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.171629:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.172007:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.172026:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcee3f58/0x5d2988b0929d0743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599607.172708:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.172721:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.172737:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.172741:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.172749:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.172764:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.172774:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.172782:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.174729:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599607.174752:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.174767:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599607.175211:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.175226:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.175251:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.175263:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.175265:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599607.175268:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.175418:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.175426:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001041c48f/0x5d2988b0929d074a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599607.176229:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.176241:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.176255:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.176259:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.176265:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.176278:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.176287:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.176294:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.176371:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.176380:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.176388:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.176393:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.176400:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.176414:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.176423:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.176424:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.176426:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.176498:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.176504:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009190670b/0x5d2988b0929d0751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599607.176992:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599607.177189:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.177198:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.177208:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.177212:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.177217:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.177227:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.177236:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.177243:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.177969:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787599607.179325:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.179339:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.179354:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.179360:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.179375:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.179389:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.179399:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.179406:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181451:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599607.181468:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181492:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ca00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.181498:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181509:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181534:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181542:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001185d607/0x5d2988b0929d0758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181569:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599607.181573:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181580:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599607.181583:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181590:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181600:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599607.181617:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.181618:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599607.181620:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.181981:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.181989:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000917082b/0x5d2988b0929d075f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599607.182610:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.182619:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.182632:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.182637:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.182644:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.182656:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.182678:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.182686:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.182749:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787599607.183454:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599607.183463:0:18992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.183473:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=553s v=(0 0) 00010000:00010000:0.0:1787599607.183478:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599607.183482:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.183491:0:18992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.183499:0:18992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599607.183507:0:18992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183615:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599607.183623:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183632:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.183638:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183660:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183680:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183689:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b325287/0x5d2988b0929d0766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183713:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599607.183716:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183723:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599607.183726:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183734:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183744:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599607.183752:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.183754:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599607.183761:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599607.184969:0:18992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787599607.184983:0:18992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc654ab/0x5d2988b0929d076d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787599607.185105:0:18992:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787599607.185229:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17122:x1874433578038144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89003us (89777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599607.185240:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787599607.185375:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599607.185420:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17122:1874433578038144:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787599607.185436:0:17122:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787599607.185485:0:17122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17122:1874433578038272:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787599607.185527:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599607.185562:0:17122:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1787599607.185983:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599607.186368:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038272 00000100:00100000:0.0:1787599607.186381:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038272 00000100:00100000:0.0:1787599607.186441:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599607.186451:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17122:x1874433578038272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787599607.186495:0:18605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1787599607.197783:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787599607.197865:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787599607.198452:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17122:x1874433578038272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11995us (12917us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787599607.198467:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599607.199637:0:17122:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787599607.199651:0:17122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17122:1874433578038272:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787599607.199669:0:17122:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1787599607.269419:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599607.845042:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578038400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599607.845132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599607.845503:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038400 00000100:00100000:3.0:1787599607.845512:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038400 00000100:00100000:3.0:1787599607.845573:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599607.845584:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578038400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599607.845620:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787599607.845716:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578038400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599607.845725:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599607.845963:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578038400:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787599608.294278:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599608.357076:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599608.357161:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599608.357386:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038528 00000100:00100000:3.0:1787599608.357397:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038528 00000100:00100000:3.0:1787599608.357474:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599608.357485:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578038528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599608.357521:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599608.357570:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578038528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599608.357577:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599608.357845:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599608.364317:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578038656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599608.364400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599608.364551:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038656 00000100:00100000:2.0:1787599608.364559:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038656 00000100:00100000:2.0:1787599608.364623:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599608.364634:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578038656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599608.364658:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599608.364709:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578038656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599608.364717:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599608.364764:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578038656:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787599609.317043:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599610.022837:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599610.340933:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599611.373500:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599612.389491:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599612.454356:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578038784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599612.454436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.454520:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038784 00000100:00100000:1.0:1787599612.454527:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038784 00000100:00100000:1.0:1787599612.454585:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599612.454613:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578038784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599612.454649:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1787599612.455009:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599612.455014:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599612.455018:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599612.455023:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 553 00000100:00080000:2.0:1787599612.455027:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787599612.455040:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599612.455062:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b370011880 x1874433578039168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599612.455110:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599612.455114:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599612.455115:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599612.455119:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:2.0:1787599612.455121:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787599612.455125:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599612.455137:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b243479880 x1874433578039680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599612.455181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578039040:0@lo:400:kworker.0 00000100:00100000:2.0:1787599612.455225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.455256:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578039808:0@lo:400:kworker.0 00000100:00100000:2.0:1787599612.455288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.455307:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787599612.455312:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578039296:0@lo:400:kworker.0 00000100:00100000:2.0:1787599612.455330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.455344:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578039936:0@lo:400:kworker.0 00000100:00100000:2.0:1787599612.455368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.459062:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578039168:0@lo:8:kworker.0 00000100:00100000:2.0:1787599612.459171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.459218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578039680:0@lo:8:kworker.0 00000100:00100000:2.0:1787599612.459241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.461501:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039168 00000100:00100000:0.0:1787599612.461516:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039168 00000100:00100000:0.0:1787599612.461569:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039680 00000100:00100000:0.0:1787599612.461572:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039680 00000100:00100000:0.0:1787599612.461591:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599612.461600:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1874433578039168:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787599612.461625:0:18992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599612.461702:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1874433578039168:12345-0@lo:8:kworker.0 Request processed in 102us (2530us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599612.461709:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599612.461724:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599612.461729:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1874433578039680:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787599612.461738:0:18992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599612.461762:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1874433578039680:12345-0@lo:8:kworker.0 Request processed in 32us (2519us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599612.461768:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787599612.464301:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599612.464314:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599612.464319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578039168:0@lo:8:kworker.0 00000100:00080000:2.0:1787599612.464331:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599612.464335:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599612.464338:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578039680:0@lo:8:kworker.0 00000100:00100000:1.0:1787599612.465205:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578038784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10590us (10764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465218:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787599612.465252:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599612.465284:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039808 00000100:00100000:1.0:1787599612.465291:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039808 00000100:00100000:1.0:1787599612.465333:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039296 00000100:00100000:1.0:1787599612.465337:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039296 00000100:00100000:1.0:1787599612.465349:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039936 00000100:00100000:1.0:1787599612.465352:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039936 00000100:00100000:1.0:1787599612.465374:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599612.465382:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578039808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465433:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578039808:12345-0@lo:400:kworker.0 Request processed in 53us (10144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465440:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599612.465450:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599612.465455:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578039296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465480:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578039296:12345-0@lo:400:kworker.0 Request processed in 25us (10149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465485:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599612.465495:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599612.465501:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578039936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465523:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578039936:12345-0@lo:400:kworker.0 Request processed in 24us (10155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465529:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787599612.465558:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599612.465572:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578038912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.465644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578039552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.465690:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787599612.465696:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578039424:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.465731:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578040064:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.465773:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578038912 00000100:00100000:1.0:1787599612.465777:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578038912 00000100:00100000:1.0:1787599612.465827:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599612.465834:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3646:x1874433578038912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465880:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3646:x1874433578038912:12345-0@lo:400:kworker.0 Request processed in 47us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465885:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599612.465913:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039040 00000100:00100000:1.0:1787599612.465917:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039040 00000100:00100000:1.0:1787599612.465932:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039424 00000100:00100000:1.0:1787599612.465935:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039424 00000100:00100000:1.0:1787599612.465946:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599612.465951:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.465982:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578039040:12345-0@lo:400:kworker.0 Request processed in 31us (10758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.465988:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599612.465999:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599612.466012:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578039424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.466052:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578039424:12345-0@lo:400:kworker.0 Request processed in 41us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.466058:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599612.466073:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040064 00000100:00100000:1.0:1787599612.466076:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040064 00000100:00100000:1.0:1787599612.466101:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599612.466107:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578040064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.466133:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578040064:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.466138:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787599612.466152:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599612.466176:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578039424:0@lo:400:kworker.0 00010000:00080000:1.0:1787599612.466191:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243479180 x1874433578040064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599612.466201:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578040064:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.466208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578038912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.466241:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578038784:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787599612.466265:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b370011500 x1874433578039296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599612.466275:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578039296:0@lo:400:kworker.0 00010000:00080000:1.0:1787599612.466284:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347ad80 x1874433578039936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599612.466303:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578039936:0@lo:400:kworker.0 00000100:00100000:1.0:1787599612.466314:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578039040:0@lo:400:kworker.0 00010000:00080000:1.0:1787599612.466323:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347b480 x1874433578039808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599612.466330:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578039808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599612.466609:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578039552 00000100:00100000:0.0:1787599612.466614:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578039552 00000100:00100000:0.0:1787599612.466644:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599612.466650:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578039552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599612.466686:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578039552:12345-0@lo:400:kworker.0 Request processed in 36us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.466691:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787599612.467608:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599612.467649:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578039552:0@lo:400:kworker.0 00000020:01000004:3.0:1787599612.608220:0:19419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787599612.608224:0:19419:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787599612.608226:0:19419:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787599612.608334:0:19419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b37b7a4000 00000020:01000004:3.0:1787599612.608351:0:19419:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787599612.608364:0:19419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787599612.608378:0:19419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96b345e08000) 00000020:00000080:3.0:1787599612.608411:0:19419:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787599612.717281:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787599612.728607:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787599612.730277:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787599612.731230:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787599612.736431:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787599612.736723:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787599612.737082:0:19419:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1787599612.739375:0:19419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787599612.739608:0:19419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787599612.739622:0:19419:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787599612.739633:0:19419:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929d077b 00000020:01000004:0.0:1787599612.739640:0:19419:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787599612.739661:0:19419:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787599612.739665:0:19419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787599612.739671:0:19419:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787599612.739990:0:19419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787599612.739995:0:19419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787599612.762642:0:19419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787599612.762688:0:19419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787599612.762693:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787599612.762695:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599612.762696:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599612.762697:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599612.762698:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599612.762700:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599612.762701:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599612.762703:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599612.762704:0:19419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599612.762708:0:19419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787599612.762710:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599612.762711:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599612.762712:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599612.762713:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599612.762714:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599612.762715:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599612.762716:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599612.762717:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599612.762718:0:19419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599612.762748:0:19419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787599612.762774:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787599612.764563:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.764619:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599612.764768:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040192 00000100:00100000:2.0:1787599612.764779:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040192 00000100:00100000:2.0:1787599612.764868:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787599612.764879:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:19419:x1874433578040192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599612.764911:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787599612.764915:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787599612.765168:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787599612.765555:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:19419:x1874433578040192:12345-0@lo:253:mount.lustre.0 Request processed in 677us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599612.765565:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599612.765654:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787599612.765668:0:19419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787599612.765671:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599612.765673:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787599612.765674:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599612.765675:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599612.765677:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599612.765678:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599612.765679:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599612.765681:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599612.765682:0:19419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599612.765701:0:19419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b37b7a4000 from lustre-OST0001 10000000:01000000:1.0:1787599612.765733:0:19419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787599612.765735:0:19419:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787599612.765744:0:19419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b370778000 local copy 00010000:00010000:1.0:1787599612.765754:0:19419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599612.765904:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599612.766181:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.766254:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b38130b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.777715:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040320 00000100:00100000:0.0:1787599612.777732:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040320 00000100:00100000:1.0:1787599612.777956:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599612.777969:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:19419:x1874433578040320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599612.778139:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:19419:x1874433578040320:12345-0@lo:501:mount.lustre.0 Request processed in 173us (11956us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599612.778148:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787599612.778297:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787599612.778322:0:19419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787599612.778351:0:19419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787599612.778360:0:19419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.778371:0:19419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599612.778408:0:19419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b37b7a4000 10000000:01000000:3.0:1787599612.778413:0:19419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787599612.778418:0:19419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787599612.778421:0:19419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599612.778425:0:19419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787599612.778428:0:19419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787599612.778457:0:19419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.778465:0:19419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.778474:0:19419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599612.778493:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599612.778531:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599612.778583:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599612.778654:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040448 00000100:00100000:2.0:1787599612.778660:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040448 00000100:00100000:2.0:1787599612.778693:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787599612.778700:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:19419:x1874433578040448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599612.778708:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599612.778721:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243758400/0x5d2988b0929d0789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0782 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.778741:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243758400/0x5d2988b0929d0789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0782 expref: 22 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.778764:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243758400/0x5d2988b0929d0789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0782 expref: 22 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.778773:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758400, rc 0) 00000100:00100000:2.0:1787599612.778841:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040448:12345-0@lo:101:mount.lustre.0 Request processed in 142us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599612.778856:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787599612.778938:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599612.778952:0:19419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.778961:0:19419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599612.780239:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787599612.781090:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599612.787157:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787599612.787219:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787599612.787235:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787599612.787249:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787599612.787263:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787599612.787276:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787599612.787303:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787599612.787309:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787599612.787425:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599612.787496:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.787544:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b38130b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599612.787711:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040576 00000100:00100000:2.0:1787599612.787719:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040576 00000100:00100000:2.0:1787599612.787769:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599612.787780:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599612.787983:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040576:12345-0@lo:501:mount.lustre.0 Request processed in 203us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599612.787991:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787599612.788225:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599612.788271:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599612.788320:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599612.788341:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351031d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.788418:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040704 00000100:00100000:1.0:1787599612.788423:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040704 00000100:00100000:1.0:1787599612.788452:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787599612.788459:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599612.790309:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040704:12345-0@lo:503:mount.lustre.0 Request processed in 1841us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.790323:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599612.792353:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599612.794071:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599612.794203:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599612.794286:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599612.794337:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b35ac31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.794524:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040832 00000100:00100000:0.0:1787599612.794538:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040832 00000100:00100000:0.0:1787599612.794593:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599612.794603:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.797125:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040832:12345-0@lo:502:mount.lustre.0 Request processed in 2515us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.797141:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599612.799044:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599612.799309:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787599612.799342:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787599612.799356:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787599612.799384:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787599612.799398:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787599612.799409:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787599612.799420:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787599612.799443:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787599612.799463:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787599612.799502:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599612.799577:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599612.799620:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b35ac31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.799930:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578040960 00000100:00100000:0.0:1787599612.799938:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578040960 00000100:00100000:0.0:1787599612.799989:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599612.799999:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.800122:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578040960:12345-0@lo:502:mount.lustre.0 Request processed in 124us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.800129:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599612.801181:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578040960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599612.801257:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787599612.801268:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787599612.805996:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599612.806020:0:19423:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787599612.806040:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.806043:0:19423:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787599612.806051:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599612.806069:0:19423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96b34dcfcd28) 00000020:00000080:1.0:1787599612.806112:0:19423:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787599612.806120:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787599612.806209:0:19423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37b7a4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787599612.806218:0:19423:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787599612.806225:0:19423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929d0797 00010000:00010000:1.0:1787599612.816333:0:19423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787599612.816910:0:19423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787599612.822503:0:19423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1787599612.830329:0:19423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787599612.830344:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599612.830352:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599612.830354:0:19423:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787599612.830358:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599612.830362:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599612.830363:0:19423:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599612.830367:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599612.830369:0:19423:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599612.830371:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599612.830373:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599612.830375:0:19423:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787599612.830376:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599612.830378:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599612.830379:0:19423:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787599612.830382:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787599612.830412:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599612.830415:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599612.830417:0:19423:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787599612.830420:0:19423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787599612.830892:0:19419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787599612.830932:0:19419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787599612.830951:0:19419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.830963:0:19419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599612.830971:0:19419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37b7a4000 from 1 10000000:01000000:0.0:1787599612.830974:0:19419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599612.831023:0:19419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.831031:0:19419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.831060:0:19419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.831084:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599612.831157:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.831211:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599612.831379:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041088 00000100:00100000:3.0:1787599612.831389:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041088 00000100:00100000:3.0:1787599612.831444:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599612.831456:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:19419:x1874433578041088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599612.831476:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599612.831489:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d079e expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.831514:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d079e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.831524:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d079e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599612.831534:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200da00, rc 0) 00000100:00100000:3.0:1787599612.831575:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041088:12345-0@lo:101:mount.lustre.0 Request processed in 122us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599612.831583:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599612.833074:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599612.833110:0:19419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.833122:0:19419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599612.841649:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787599612.843196:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599612.843425:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787599612.843450:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787599612.843468:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787599612.843473:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787599612.843568:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599612.843642:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.848937:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.852221:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041216 00000100:00100000:1.0:1787599612.852239:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041216 00000100:00100000:1.0:1787599612.852301:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787599612.852312:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599612.852495:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041216:12345-0@lo:501:mount.lustre.0 Request processed in 185us (8853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.852504:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787599612.852773:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599612.853582:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599612.853653:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.853702:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.857074:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041344 00000100:00100000:1.0:1787599612.857091:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041344 00000100:00100000:1.0:1787599612.857164:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787599612.857175:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599612.857341:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041344:12345-0@lo:503:mount.lustre.0 Request processed in 168us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.857350:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787599612.857637:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599612.858249:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599612.858331:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.858396:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.858435:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.860786:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041472 00000100:00100000:1.0:1787599612.860831:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041472 00000100:00100000:1.0:1787599612.860908:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787599612.860943:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599612.861130:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041472:12345-0@lo:502:mount.lustre.0 Request processed in 190us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.861139:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787599612.861371:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599612.861658:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787599612.861695:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787599612.861711:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787599612.861726:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787599612.861737:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787599612.861750:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787599612.861762:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787599612.861774:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787599612.861787:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787599612.861826:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787599612.861841:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787599612.861893:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599612.861960:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.861999:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599612.863199:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041600 00000100:00100000:3.0:1787599612.863209:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041600 00000100:00100000:3.0:1787599612.863254:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787599612.863263:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599612.863439:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041600:12345-0@lo:502:mount.lustre.0 Request processed in 175us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599612.863447:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599612.863724:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599612.864109:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787599612.864131:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787599612.865460:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599612.865471:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865474:0:19427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599612.865480:0:19427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37b7a4000 00000020:00000080:1.0:1787599612.865483:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599612.865489:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599612.865491:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865493:0:19427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787599612.865495:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599612.865497:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865498:0:19427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599612.865501:0:19427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37b7a4000 00000020:00000080:1.0:1787599612.865503:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599612.865562:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599612.865566:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865568:0:19427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787599612.865570:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599612.865572:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865573:0:19427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599612.865576:0:19427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37b7a4000 00000020:00000080:1.0:1787599612.865578:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599612.865596:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599612.865598:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865599:0:19427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599612.865601:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599612.865603:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865605:0:19427:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787599612.865608:0:19427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37b7a4000 00000020:00000080:1.0:1787599612.865615:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599612.865639:0:19427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599612.865642:0:19427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599612.865643:0:19427:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787599612.865646:0:19427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787599612.868040:0:19419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787599612.868102:0:19419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599612.868121:0:19419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.868136:0:19419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599612.868206:0:19419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787599612.868209:0:19419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b37b7a4000 10000000:01000000:2.0:1787599612.868212:0:19419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b37b7a4000 10000000:01000000:2.0:1787599612.868216:0:19419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599612.868222:0:19419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37b7a4000 from 1 10000000:01000000:2.0:1787599612.868225:0:19419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599612.868264:0:19419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.868273:0:19419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599612.868284:0:19419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599612.868314:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599612.868404:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.868458:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.868822:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041728 00000100:00100000:0.0:1787599612.868830:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041728 00000100:00100000:0.0:1787599612.868893:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787599612.868904:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:19419:x1874433578041728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599612.868932:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599612.868948:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3c000/0x5d2988b0929d07b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d07ac expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.868974:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3c000/0x5d2988b0929d07b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d07ac expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.868984:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3c000/0x5d2988b0929d07b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d07ac expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.868992:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c000, rc 0) 00000100:00100000:0.0:1787599612.869049:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578041728:12345-0@lo:101:mount.lustre.0 Request processed in 146us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.869056:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787599612.869103:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599612.869118:0:19419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.869127:0:19419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599612.873000:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787599612.873330:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599612.873542:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787599612.873566:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787599612.873580:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787599612.873592:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787599612.873605:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787599612.873620:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787599612.873633:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787599612.873646:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787599612.873658:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787599612.873671:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787599612.873684:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787599612.873713:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787599612.873728:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787599612.873740:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787599612.873755:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787599612.873769:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787599612.873782:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787599612.873826:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787599612.873842:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787599612.873872:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787599612.873885:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787599612.873897:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787599612.873910:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787599612.873924:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787599612.873937:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787599612.873950:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787599612.873964:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787599612.873992:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787599612.874007:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787599612.874034:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787599612.874048:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787599612.874062:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787599612.874076:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787599612.874089:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787599612.874103:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787599612.874115:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787599612.874127:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787599612.874139:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787599612.874152:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787599612.874164:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787599612.874175:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787599612.874187:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787599612.874200:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787599612.874228:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787599612.874245:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787599612.874259:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787599612.874280:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787599612.874286:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787599612.874393:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599612.874480:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.889209:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.890730:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041856 00000100:00100000:1.0:1787599612.890745:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041856 00000100:00100000:1.0:1787599612.890829:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787599612.890840:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578041856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599612.891146:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578041856:12345-0@lo:501:mount.lustre.0 Request processed in 308us (16665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.891155:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787599612.896602:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599612.896670:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599612.896751:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.896827:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599612.896941:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578041984 00000100:00100000:3.0:1787599612.896948:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578041984 00000100:00100000:3.0:1787599612.897002:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787599612.897021:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578041984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599612.897133:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578041984:12345-0@lo:503:mount.lustre.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599612.897150:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599612.897338:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578041984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599612.897776:0:19419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599612.897906:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.898125:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.898159:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.898183:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042112 00000100:00100000:0.0:1787599612.898188:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042112 00000100:00100000:0.0:1787599612.898224:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599612.898232:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.898327:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042112:12345-0@lo:502:mount.lustre.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.898335:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599612.898377:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599612.898554:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787599612.898579:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787599612.898594:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787599612.898609:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787599612.898623:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787599612.898636:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787599612.898647:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787599612.898658:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787599612.898669:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787599612.898682:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787599612.898708:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787599612.898723:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787599612.898735:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787599612.898747:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787599612.898760:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787599612.898773:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787599612.898786:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787599612.898826:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787599612.898841:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787599612.898876:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787599612.898891:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787599612.898904:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787599612.899886:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787599612.900186:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787599612.900208:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787599612.900222:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787599612.900253:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787599612.900270:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787599612.900284:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787599612.900297:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787599612.900308:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787599612.900321:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787599612.900333:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787599612.900347:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787599612.900361:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787599612.900374:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787599612.900388:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787599612.900403:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787599612.900418:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787599612.900434:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787599612.900447:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787599612.900461:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787599612.900490:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787599612.900507:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787599612.900522:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787599612.900536:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787599612.900551:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787599612.900564:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787599612.900623:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.900716:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.900758:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.900832:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042240 00000100:00100000:0.0:1787599612.900842:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042240 00000100:00100000:0.0:1787599612.900898:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599612.900907:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.905964:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042240:12345-0@lo:502:mount.lustre.0 Request processed in 5043us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.905981:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599612.912711:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599612.913043:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787599612.913078:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787599612.913123:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599612.913208:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.915633:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.916638:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042368 00000100:00100000:0.0:1787599612.916651:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042368 00000100:00100000:0.0:1787599612.916707:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599612.916717:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599612.917157:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042368:12345-0@lo:502:mount.lustre.0 Request processed in 439us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.917167:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599612.917231:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599612.917326:0:19419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787599612.917341:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787599612.921245:0:19432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787599612.921263:0:19432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96b242c3cd28) 00000020:00000080:0.0:1787599612.921289:0:19432:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787599612.921380:0:19432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37b7a4000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599612.921384:0:19432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37b7a4000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599612.921387:0:19432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37b7a4000 3 00010000:00080000:0.0:1787599612.921419:0:19432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b347dc9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1787599612.925914:0:19432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787599612.928500:0:19432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787599612.928549:0:19432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599612.928571:0:19432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d2988b0929d07c1 00000100:00080000:0.0:1787599612.928582:0:19432:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599612.928588:0:19432:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b347dc9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599612.928636:0:19432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138f800 x1874433578042496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599612.928679:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578042496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787599612.928746:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.928827:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042496 00000100:00100000:0.0:1787599612.928835:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042496 00000100:00100000:0.0:1787599612.937193:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599612.937207:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874433578042496:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787599612.937245:0:17098:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:0.0:1787599612.937321:0:17098:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d2988b0929d07c8 00000004:00100000:0.0:1787599612.937341:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599612.937385:0:17098:0:(import.c:65:import_set_state_nolock()) ffff96b241a59000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599612.937501:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874433578042496:12345-0@lo:38:llog_process_th.0 Request processed in 294us (8752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.937509:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787599612.937583:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b38138f800 x1874433578042496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599612.937596:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599612.937605:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787599612.937614:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787599612.937619:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787599612.937622:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787599612.937629:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578042496:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787599612.937666:0:19432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1787599612.954188:0:19432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787599612.954206:0:19432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff96b344af99b8) 00000020:00000080:2.0:1787599612.954232:0:19432:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787599612.954384:0:19432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37b7a4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787599612.954389:0:19432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37b7a4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787599612.954392:0:19432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37b7a4000 3 00010000:00080000:2.0:1787599612.954424:0:19432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b244111800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599612.958203:0:19432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787599612.958469:0:19432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787599612.958515:0:19432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599612.958528:0:19432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5d2988b0929d07d6 00000100:00080000:2.0:1787599612.958539:0:19432:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599612.958545:0:19432:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96b244111800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599612.958579:0:19432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24347b800 x1874433578042624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599612.968415:0:19432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787599612.968752:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578042624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787599612.968868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.968960:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042624 00000100:00100000:0.0:1787599612.968968:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042624 00000100:00100000:0.0:1787599612.969002:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599612.969010:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874433578042624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787599612.969042:0:18087:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:0.0:1787599612.969077:0:18087:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5d2988b0929d07dd 00000004:00100000:0.0:1787599612.969102:0:18087:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599612.969135:0:18087:0:(import.c:65:import_set_state_nolock()) ffff96b241a5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599612.969184:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874433578042624:12345-0@lo:38:llog_process_th.0 Request processed in 173us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599612.969191:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787599612.969230:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347b800 x1874433578042624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599612.969242:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599612.969250:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787599612.969257:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787599612.969261:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787599612.969263:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244111800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787599612.969269:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578042624:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787599612.970678:0:19432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787599612.970733:0:19419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787599612.970763:0:19419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599612.970787:0:19419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.970814:0:19419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599612.970872:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599612.970875:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599612.970876:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599612.970877:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599612.970879:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599612.970880:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599612.970882:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599612.970884:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599612.970885:0:19419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599612.970889:0:19419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787599612.970892:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599612.970893:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599612.970894:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599612.970895:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599612.970896:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599612.970897:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599612.970898:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599612.970899:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599612.970900:0:19419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599612.970929:0:19419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787599612.970946:0:19419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599612.971001:0:19419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.971032:0:19419:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599612.971053:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042752 00000100:00100000:0.0:1787599612.971059:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042752 00000100:00100000:0.0:1787599612.971095:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599612.971104:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:19419:x1874433578042752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599612.971127:0:17090:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787599612.971147:0:17090:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787599612.972517:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578042880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599612.972574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599612.972678:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578042880 00000100:00100000:2.0:1787599612.972687:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578042880 00000100:00100000:2.0:1787599612.972748:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599612.972757:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578042880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599612.972823:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787599612.972880:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578042880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599612.972887:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599612.973068:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578042880:0@lo:41:osp-pre-0-1.0 20000000:01000000:1.0:1787599612.981353:0:17090:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599612.981398:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787599612.981965:0:17113:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599612.981970:0:17113:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599612.981990:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982008:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d068d expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982017:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d069b expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982025:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982061:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982075:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 24 pid: 17091 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.982145:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578043008:0@lo:104: 00000100:00100000:0.0:1787599612.982212:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599612.982297:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.982306:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 24 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.982326:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578043136:0@lo:104: 00000100:00100000:0.0:1787599612.982346:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599612.982454:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599612.982510:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043008 00000100:00100000:1.0:1787599612.982517:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043008 00000100:00100000:1.0:1787599612.982549:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043136 00000100:00100000:1.0:1787599612.982551:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043136 00000100:00100000:1.0:1787599612.982562:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599612.982569:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578043008:12345-0@lo:104: 00010000:00010000:1.0:1787599612.982581:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.982671:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599612.982677:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:17113:x1874433578043008:12345-0@lo:104: Request processed in 108us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.982684:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599612.982700:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599612.982714:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578043136:12345-0@lo:104: 00010000:00010000:1.0:1787599612.982721:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.982749:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599612.982754:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:17113:x1874433578043136:12345-0@lo:104: Request processed in 41us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.982759:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787599612.982772:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599612.982778:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.982784:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599612.982788:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.982923:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599612.982930:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599612.982936:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599612.982968:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983006:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599612.983026:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983033:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d069b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d06a2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983044:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599612.983048:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983054:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599612.983056:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983062:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599612.983067:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599612.983072:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599612.983083:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983152:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599612.983158:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983173:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e5600/0x5d2988b0929d068d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0694 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983186:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599612.983188:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599612.983189:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599612.983210:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578043264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599612.983237:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.983259:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599612.983264:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578043392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599612.983281:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599612.983348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599612.983388:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043264 00000100:00100000:1.0:1787599612.983393:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043264 00010000:00010000:1.0:1787599612.983410:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 25 pid: 17091 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599612.983429:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043392 00000100:00100000:1.0:1787599612.983431:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043392 00010000:00010000:1.0:1787599612.983441:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 26 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599612.983467:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599612.983474:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+26:3647:x1874433578043264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599612.983499:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599612.983505:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 26 pid: 17091 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983515:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 26 pid: 17091 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983534:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599612.983559:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+26:3647:x1874433578043264:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.983565:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599612.983578:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599612.983585:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+25:3647:x1874433578043392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599612.983591:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599612.983595:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 25 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983603:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 25 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983613:0:17084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983621:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787599612.983632:0:17084:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018659547s 00010000:00010000:1.0:1787599612.983637:0:17084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983644:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983649:0:17084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983666:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983671:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599612.983675:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983681:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983688:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599612.983697:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599612.983896:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+25:19419:x1874433578042752:12345-0@lo:253:mount.lustre.0 Request processed in 12791us (12893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599612.983912:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599612.984040:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3647:x1874433578043392:12345-0@lo:103:ldlm_bl.0 Request processed in 455us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599612.984047:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599612.984079:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578043392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599612.984156:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578043264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599612.984228:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e4400/0x5d2988b0929d06a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d069b expref: 23 pid: 17091 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.984239:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578043008:0@lo:104: 00010000:00010000:0.0:1787599612.984249:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d068d expref: 22 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.984256:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17113:1874433578043136:0@lo:104: 00010000:00010000:0.0:1787599612.984330:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.984343:0:17113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.984350:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599612.984356:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d07e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599612.984422:0:19419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:19419:1874433578042752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787599612.984432:0:19419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787599612.984435:0:19419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599612.984437:0:19419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599612.984444:0:19419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599612.984446:0:19419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599612.984447:0:19419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599612.984448:0:19419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599612.984450:0:19419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599612.984451:0:19419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599612.984453:0:19419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787599612.984463:0:19419:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787599612.987247:0:19419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787599612.989731:0:19419:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787599612.989739:0:19419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787599612.989774:0:19419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599612.989990:0:19419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599612.990012:0:19419:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787599612.990029:0:19419:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787599612.991024:0:19419:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599612.991233:0:19419:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599613.416829:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599613.483096:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599613.483124:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578043520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599613.483201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599613.483256:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043520 00000100:00100000:3.0:1787599613.483264:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043520 00000100:00100000:3.0:1787599613.483315:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599613.483325:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578043520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599613.483378:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599613.483425:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578043520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599613.483433:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599613.483479:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578043520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599613.485158:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578043648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599613.485220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599613.485414:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043648 00000100:00100000:0.0:1787599613.485422:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043648 00000100:00100000:0.0:1787599613.485482:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599613.485493:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578043648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599613.485518:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599613.485563:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578043648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599613.485570:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599613.485710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578043648:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787599613.989076:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599613.989086:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f890800 from 10 10000000:01000000:1.0:1787599613.989092:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599613.989139:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599613.989152:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599613.989177:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599613.989202:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578043776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599613.989267:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599613.989307:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599613.989373:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043776 00000100:00100000:3.0:1787599613.989381:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043776 00000100:00100000:3.0:1787599613.989428:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787599613.989437:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578043776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599613.989448:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599613.989460:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d07f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d07eb expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989491:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d07f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d07eb expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989502:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d07f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d07eb expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989511:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599613.989547:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578043776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599613.989553:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787599613.989591:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578043776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599613.989603:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989612:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599613.989650:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578043904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787599613.989676:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599613.989688:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599613.989699:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578043904 00000100:00100000:3.0:1787599613.989702:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578043904 00000100:00100000:3.0:1787599613.989719:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787599613.989724:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578043904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787599613.989736:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599613.989749:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599613.989755:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787599613.989864:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578043904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599613.989871:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787599613.989900:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578043904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787599613.989952:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599613.989959:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989968:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599613.989976:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787599613.989978:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b377a86000 from 10 10000000:01000000:3.0:1787599613.989980:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599613.989992:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.989999:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990007:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599613.990017:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578044032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599613.990038:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599613.990054:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599613.990064:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044032 00000100:00100000:3.0:1787599613.990067:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044032 00000100:00100000:3.0:1787599613.990090:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787599613.990095:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578044032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599613.990101:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599613.990108:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d07f9 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990121:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d07f9 expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990128:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d07f9 expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990135:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200de00, rc 0) 00000100:00100000:3.0:1787599613.990156:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578044032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599613.990161:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787599613.990183:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578044032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599613.990192:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990199:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599613.990228:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578044160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787599613.990249:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599613.990259:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599613.990268:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044160 00000100:00100000:3.0:1787599613.990271:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044160 00000100:00100000:3.0:1787599613.990295:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787599613.990300:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578044160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787599613.990309:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599613.990319:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599613.990322:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787599613.990376:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578044160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599613.990383:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787599613.990406:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578044160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787599613.990434:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599613.990439:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599613.990447:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599613.995703:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1787599614.097364:0:19486:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599614.097587:0:19486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787599614.436935:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599615.466440:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599616.486824:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599617.512769:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599617.574446:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599617.574519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599617.574729:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044288 00000100:00100000:1.0:1787599617.574738:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044288 00000100:00100000:1.0:1787599617.574833:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599617.574844:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578044288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599617.574873:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599617.574931:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578044288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599617.574938:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787599617.575114:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599617.575201:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578044288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599618.087421:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599618.087445:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578044416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599618.087518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599618.087568:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044416 00000100:00100000:3.0:1787599618.087577:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044416 00000100:00100000:3.0:1787599618.087624:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599618.087634:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578044416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599618.087670:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787599618.087715:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578044416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599618.087733:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599618.087779:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578044416:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787599618.096186:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599618.096192:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787599618.096196:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599618.096205:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:0.0:1787599618.096209:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787599618.096216:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b3707b7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599618.096238:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138c700 x1874433578044800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599618.096276:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599618.096279:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787599618.096280:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599618.096284:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:0.0:1787599618.096294:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787599618.096298:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b242df9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599618.096311:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b38138ce00 x1874433578045184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599618.096368:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578044672:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096478:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578045440:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787599618.096536:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578044544:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096579:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578045312:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096613:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578045824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096653:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578044800:0@lo:8:kworker.0 00000100:00100000:0.0:1787599618.096676:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096695:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578045184:0@lo:8:kworker.0 00000100:00100000:0.0:1787599618.096716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096742:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578044928:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.096785:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578045568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.096848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.098991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599618.099024:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578045056:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.099186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578045696:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.099251:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044672 00000100:00100000:0.0:1787599618.099260:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044672 00000100:00100000:0.0:1787599618.099318:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599618.099327:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099387:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578044672:12345-0@lo:400:kworker.0 Request processed in 61us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099396:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599618.099422:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045440 00000100:00100000:0.0:1787599618.099426:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045440 00000100:00100000:0.0:1787599618.099459:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045312 00000100:00100000:0.0:1787599618.099462:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045312 00000100:00100000:0.0:1787599618.099472:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045824 00000100:00100000:0.0:1787599618.099474:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045824 00000100:00100000:0.0:1787599618.099485:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044928 00000100:00100000:0.0:1787599618.099487:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044928 00000100:00100000:0.0:1787599618.099495:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045568 00000100:00100000:0.0:1787599618.099497:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045568 00000100:00100000:0.0:1787599618.099507:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045696 00000100:00100000:0.0:1787599618.099508:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045696 00000100:00100000:0.0:1787599618.099519:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599618.099524:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578045440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099555:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578045440:12345-0@lo:400:kworker.0 Request processed in 31us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099561:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599618.099570:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599618.099582:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578045312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099607:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578045312:12345-0@lo:400:kworker.0 Request processed in 26us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099612:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599618.099623:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599618.099628:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578045824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099651:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578045824:12345-0@lo:400:kworker.0 Request processed in 23us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099656:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599618.099666:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599618.099671:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578044928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099699:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578044928:12345-0@lo:400:kworker.0 Request processed in 28us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099704:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599618.099714:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599618.099719:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578045568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099760:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578045568:12345-0@lo:400:kworker.0 Request processed in 41us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599618.099766:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599618.099777:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599618.099782:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578045696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.099848:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578045696:12345-0@lo:400:kworker.0 Request processed in 66us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.100149:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044800 00000100:00100000:2.0:1787599618.100156:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044800 00000100:00100000:2.0:1787599618.100177:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045184 00000100:00100000:2.0:1787599618.100181:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045184 00000100:00100000:2.0:1787599618.100189:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045056 00000100:00100000:2.0:1787599618.100192:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045056 00000100:00100000:2.0:1787599618.100213:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599618.100220:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578045056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599618.100255:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578045056:12345-0@lo:400:kworker.0 Request processed in 35us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.100261:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599618.100274:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599618.100279:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578044800:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787599618.100307:0:18604:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:2.0:1787599618.100342:0:18604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0807 00002000:00100000:2.0:1787599618.100355:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96b34de1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787599618.100359:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787599618.100362:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787599618.100549:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787599618.100577:0:18604:0:(import.c:65:import_set_state_nolock()) ffff96b34de1e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599618.100621:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578044800:12345-0@lo:8:kworker.0 Request processed in 340us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.100627:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599618.100641:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599618.100645:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578045184:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787599618.100660:0:18604:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:2.0:1787599618.100675:0:18604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d080e 00002000:00100000:2.0:1787599618.100681:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff96b34de1d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787599618.100684:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787599618.100686:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787599618.100707:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787599618.100718:0:18604:0:(import.c:65:import_set_state_nolock()) ffff96b34de1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599618.100746:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578045184:12345-0@lo:8:kworker.0 Request processed in 100us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.100752:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599618.101367:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578044544 00000100:00100000:2.0:1787599618.101374:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578044544 00000100:00100000:2.0:1787599618.101417:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787599618.101424:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578044544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599618.101467:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578044544:12345-0@lo:400:kworker.0 Request processed in 43us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.101481:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787599618.101963:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599618.102023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578044544:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102206:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138d180 x1874433578045312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102218:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578045312:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102230:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d3800 x1874433578045824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578045824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599618.102250:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578044672:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102262:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e4000 x1874433578045440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578045440:0@lo:400:kworker.0 00000100:00080000:0.0:1787599618.102305:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599618.102311:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599618.102313:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599618.102333:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578045056:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e5500 x1874433578045696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102355:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578045696:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102367:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138ed80 x1874433578044928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578044928:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102387:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e6a00 x1874433578045568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102407:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578045568:0@lo:400:kworker.0 00010000:00080000:0.0:1787599618.102443:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138c700 x1874433578044800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102451:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599618.102459:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787599618.102466:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787599618.102472:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787599618.102475:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787599618.102504:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787599618.102510:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578044800:0@lo:8:kworker.0 00010000:00080000:0.0:1787599618.102524:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b38138ce00 x1874433578045184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.102530:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787599618.102535:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787599618.102540:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787599618.102543:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787599618.102545:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787599618.102555:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787599618.102558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578045184:0@lo:8:kworker.0 00000004:00080000:3.0:1787599618.102953:0:17123:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787599618.103120:0:17123:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 564722326054ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787599618.103128:0:17123:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787599618.103233:0:17124:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787599618.103254:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17124:1874433578046080:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787599618.103306:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599618.103333:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18d80 going to sleep for 11 seconds 00000004:00080000:2.0:1787599618.103362:0:17841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787599618.103376:0:17841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046336:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787599618.103399:0:17841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599618.103413:0:17841:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d186c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787599618.103424:0:17840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787599618.103474:0:17840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 564722681129ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787599618.103480:0:17840:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787599618.104056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599618.104074:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578045952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599618.104108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599618.104224:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578045952 00000100:00100000:1.0:1787599618.104232:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578045952 00000100:00100000:1.0:1787599618.104289:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599618.104301:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578045952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599618.104329:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787599618.104375:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578045952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599618.104382:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787599618.104428:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24347b100 x1874433578045952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599618.104446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578045952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599618.105440:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578046208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599618.105481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787599618.105517:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599618.106085:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046208 00000100:00100000:3.0:1787599618.106093:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046208 00000100:00100000:3.0:1787599618.106135:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599618.106144:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433578046208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599618.106163:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787599618.106211:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433578046208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599618.106217:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599618.106638:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046080 00000100:00100000:2.0:1787599618.106644:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046080 00000100:00100000:2.0:1787599618.106681:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046336 00000100:00100000:2.0:1787599618.106685:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046336 00000100:00100000:2.0:1787599618.106706:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599618.106713:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17124:x1874433578046080:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1787599618.107206:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787599618.107244:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243478000 x1874433578046208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.107281:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578046208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599618.107527:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599618.107538:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17841:x1874433578046336:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787599618.108246:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787599618.108639:0:17830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787599618.116124:0:18606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787599618.116140:0:18606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787599618.116145:0:18606:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:2.0:1787599618.123541:0:18992:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787599618.123551:0:18992:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787599618.126817:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17841:x1874433578046336:12345-0@lo:7:osp-pre-1-1.0 Request processed in 19245us (23381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.126834:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787599618.127142:0:17841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b24347b800 x1874433578046336/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599634 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.127159:0:17841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046336:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787599618.127174:0:17841:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787599618.127216:0:17841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046464:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787599618.127269:0:17841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599618.127302:0:17841:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2440663c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787599618.127529:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.127539:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127560:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.127572:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.127580:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127603:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127615:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127623:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127644:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.127657:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.127664:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127673:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.127677:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127686:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127703:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127720:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000696ec16e/0x5d2988b0929d0815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.127738:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.127741:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.127742:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599618.128343:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046464 00000100:00100000:2.0:1787599618.128351:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046464 00000100:00100000:2.0:1787599618.128400:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599618.128410:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17841:x1874433578046464:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787599618.128442:0:18604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787599618.128497:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17841:x1874433578046464:12345-0@lo:5:osp-pre-1-1.0 Request processed in 88us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.128504:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599618.128540:0:17841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046464:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787599618.128550:0:17841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787599618.128582:0:17841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046592:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787599618.128609:0:17841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599618.128624:0:17841:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599618.128635:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046592 00000100:00100000:2.0:1787599618.128639:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046592 00000100:00100000:2.0:1787599618.128661:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599618.128668:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17841:x1874433578046592:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787599618.128690:0:18992:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1787599618.130335:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.130349:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130365:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.130370:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.130377:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130390:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130400:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130408:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130427:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.130438:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.130449:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130457:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.130462:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130470:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130486:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130494:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a8c5f71/0x5d2988b0929d081c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.130510:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.130512:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.130514:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.131538:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.131546:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131558:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.131562:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.131567:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131590:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131600:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131609:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131624:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.131633:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.131638:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131646:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.131650:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131658:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131670:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131678:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d0823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.131697:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.131698:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.131700:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.133184:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.133195:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.133209:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.133213:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.133217:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.133230:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.133253:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.133261:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.133278:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.133489:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.133496:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.133504:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.133508:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.133517:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.133533:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.133542:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d082a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.133559:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.133561:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.133563:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.134511:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.134522:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.134535:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.134539:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.134544:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.134555:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.134564:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.134572:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.134600:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.134827:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.134833:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.134921:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.134927:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.134936:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.134952:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.134961:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.134985:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.134987:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.134989:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.135372:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.135381:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.135390:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.135393:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.135398:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.135406:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.135414:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.135422:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.135437:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.135987:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.135995:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136004:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.136008:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136017:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136114:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136123:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136145:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.136147:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.136149:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.136584:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.136592:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136603:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.136607:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.136612:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136622:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136632:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136640:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136664:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.136672:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.136677:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136685:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.136689:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136697:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136709:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136717:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d083f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.136731:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.136732:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.136734:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.138525:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.138539:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.138554:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.138563:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.138569:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.138583:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.138594:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.138602:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.138623:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.138771:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.138779:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.138787:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.138825:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.138834:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139288:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139300:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063d6d369/0x5d2988b0929d0846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139323:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.139325:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.139327:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.139737:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.139743:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139750:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.139752:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.139756:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139763:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139769:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139778:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.139818:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.139832:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.139838:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.139846:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.139850:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.139859:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.139875:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.139882:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d084d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.139900:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.139902:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.139903:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.141153:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.141164:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.141178:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.141182:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.141187:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.141200:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.141210:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.141218:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.141234:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599618.141563:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599618.141572:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.141582:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599618.141586:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.141595:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.141615:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.141624:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d0854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.141656:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.141658:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.141659:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.142822:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.142837:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.143383:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.143388:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.143397:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.143412:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.143424:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.143434:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.143457:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.143466:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.143473:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.143491:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.143495:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.143503:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.143519:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.143526:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d085b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.143549:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.143552:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.143553:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.144567:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.144578:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.144590:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.144594:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.144599:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.144609:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.144629:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.144637:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.144661:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.144934:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.144940:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.144946:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.144948:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.144954:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.144969:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.144982:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.144994:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.144995:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.144996:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.147159:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.147173:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.147191:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.147196:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.147202:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.147215:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.147225:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.147233:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.147267:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.147366:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.147373:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.147382:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.147386:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.147395:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.147417:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.147424:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d0869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.147441:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.147443:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.147445:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.148175:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.148185:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.148196:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.148200:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.148204:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.148215:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.148223:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.148230:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.148247:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599618.148617:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599618.148623:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.148632:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599618.148636:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.148644:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.148659:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.148666:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d0870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.148682:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.148684:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599618.148685:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.150125:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.150138:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.150154:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.150158:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.150163:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.150175:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.150184:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.150191:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.150215:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.150890:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.150898:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.150908:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.150913:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.150922:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.150940:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.150947:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ed4109/0x5d2988b0929d0877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.150978:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.150980:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.150982:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.151450:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.151459:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.151469:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.151472:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.151476:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.151504:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.151513:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.151519:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.151544:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.151733:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.151739:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.151748:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.151752:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.151760:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.151773:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.151781:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0a0453/0x5d2988b0929d087e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.151833:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.151835:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.151837:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599618.152949:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599618.152963:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.152984:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1787599618.152988:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599618.152993:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.153005:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.153013:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.153231:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599618.153248:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.153620:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.153627:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.153636:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.153647:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.153656:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.153672:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.153680:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000514f2ad3/0x5d2988b0929d0885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.153699:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.153701:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.153703:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.161225:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.161238:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.161257:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.161262:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.161269:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.161282:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.161294:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.161309:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.161334:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.161427:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.161435:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.161454:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.161459:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.161468:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.161486:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.161492:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d088c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.161513:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.161515:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.161517:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599618.163917:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599618.163934:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.163952:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1787599618.163956:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599618.164023:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.164111:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.164121:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.164129:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.164153:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.167736:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.167750:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.167763:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.167767:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.167778:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.167832:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.167841:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d0893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.167864:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.167866:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.167868:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599618.169246:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599618.169260:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.169275:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787599618.169280:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599618.169287:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.169299:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.169308:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.169317:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174716:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.174738:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.174747:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174766:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.174771:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174782:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174832:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174840:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fc654ab/0x5d2988b0929d089a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.174873:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.174875:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.174877:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599618.179492:0:19420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787599618.179526:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787599618.179531:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787599618.179587:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599618.179598:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.179615:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1787599618.179626:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599618.179634:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.179650:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.179660:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.179668:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.179691:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599618.179876:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599618.179883:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.179892:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ca00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599618.179897:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.179907:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.179924:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.179932:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001185d607/0x5d2988b0929d08a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.179950:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.179952:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599618.179953:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599618.180221:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17841:x1874433578046592:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51548us (51606us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787599618.180234:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599618.180411:0:17841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787599618.180421:0:17841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17841:1874433578046592:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787599618.180440:0:17841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787599618.180492:0:17841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17841:1874433578046720:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787599618.180530:0:17841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599618.180561:0:17841:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787599618.180997:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046720 00000100:00100000:3.0:1787599618.181006:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046720 00000100:00100000:3.0:1787599618.181260:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599618.181270:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17841:x1874433578046720:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787599618.181337:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17841:x1874433578046720:12345-0@lo:900:osp-pre-1-1.0 Request processed in 68us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599618.181344:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787599618.181684:0:17841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377afe300 x1874433578046720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599634 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599618.181698:0:17841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17841:1874433578046720:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787599618.181733:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.181741:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.181757:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.181761:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.181767:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.181779:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.181789:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.181840:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.181862:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599618.181941:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599618.181947:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.181955:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599618.181959:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.181978:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182000:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182007:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be92e36b/0x5d2988b0929d08a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182024:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.182025:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.182037:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.182354:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.182367:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182376:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.182380:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.182384:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182394:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182402:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182408:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182429:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599618.182463:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599618.182469:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182477:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54be00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599618.182481:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182489:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182501:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182509:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002943eec5/0x5d2988b0929d08af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.182534:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.182536:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.182537:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.182964:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.182972:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182981:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.182983:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.182988:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.182998:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.183014:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.183021:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.183043:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599618.183112:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599618.183117:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.183125:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599618.183128:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.183137:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.183149:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.183156:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a51e2f7/0x5d2988b0929d08b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599618.183170:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.183171:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599618.183173:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.185462:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.185478:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.185495:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.185499:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.185505:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.185517:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.185527:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.185534:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.185570:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.185595:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.185602:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.185616:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.185620:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.185628:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.185644:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.185651:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006bcbdee/0x5d2988b0929d08bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.185667:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.185669:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.185670:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.186244:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.186251:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186260:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.186263:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.186268:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186276:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186283:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186353:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186374:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.186387:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.186393:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186400:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.186404:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186411:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186431:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186438:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485de19f/0x5d2988b0929d08c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186451:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.186453:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.186455:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.186684:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.186689:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186698:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.186706:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.186711:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186721:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186729:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186737:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.186754:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.186779:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.186783:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186816:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.186820:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186829:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186840:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186848:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b981cc3d/0x5d2988b0929d08cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.186881:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.186883:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.186884:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599618.187431:0:18606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599618.187438:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.187448:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1787599618.187451:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599618.187779:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.187815:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.187825:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.187840:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599618.187859:0:18606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599618.187872:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599618.187879:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.187886:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599618.187890:0:17086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.187898:0:17086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787599618.187904:0:18606:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:2.0:1787599618.187909:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.187915:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cb96792/0x5d2988b0929d08d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599618.187930:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.187932:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599618.187933:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599618.188000:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17124:x1874433578046080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 81283us (84689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599618.188009:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599618.188064:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17124:1874433578046080:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787599618.188081:0:17124:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787599618.188135:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17124:1874433578046848:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787599618.188170:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599618.188204:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3469f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599618.189545:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046848 00000100:00100000:1.0:1787599618.189557:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046848 00000100:00100000:1.0:1787599618.189609:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599618.189618:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17124:x1874433578046848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787599618.189668:0:18605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1787599618.196556:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17124:x1874433578046848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6933us (8379us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787599618.196569:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599618.197952:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17124:1874433578046848:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787599618.197988:0:17124:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1787599618.535446:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599618.599929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599618.599969:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599618.600038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599618.600085:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578046976 00000100:00100000:3.0:1787599618.600093:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578046976 00000100:00100000:3.0:1787599618.600155:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599618.600165:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578046976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599618.600199:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599618.600243:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578046976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599618.600250:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599618.600313:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599618.603275:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599618.603303:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599618.603386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599618.603452:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047104 00000100:00100000:2.0:1787599618.603460:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047104 00000100:00100000:2.0:1787599618.603520:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599618.603529:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599618.603574:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599618.603624:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599618.603631:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599618.603678:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787599619.557498:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599619.717236:0:19776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787599620.262769:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599620.583099:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787599620.755708:0:19828:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599620.755989:0:19828:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599621.619579:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787599621.806764:0:19878:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599621.807267:0:19878:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787599622.074116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.076432:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086720 00000100:00100000:1.0:1787599622.076452:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086720 00000100:00100000:1.0:1787599622.076581:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1787599622.076591:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1874433559086720:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787599622.076623:0:17091:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 10394c45-c749-48e8-b612-3d793d59d9ea@192.168.202.1@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1787599622.076671:0:17091:0:(genops.c:1385:class_connect()) connect: client 10394c45-c749-48e8-b612-3d793d59d9ea, cookie 0x5d2988b0929d08d9 00000100:00080000:1.0:1787599622.076869:0:17091:0:(import.c:65:import_set_state_nolock()) ffff96b244235800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599622.076949:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+5:2402:x1874433559086720:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 357us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.076959:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1787599622.086462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.086567:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086848 00000100:00100000:3.0:1787599622.086578:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086848 00000100:00100000:3.0:1787599622.086642:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1787599622.086653:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+5:14900:x1874433559086848:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787599622.086669:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599622.086686:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e4000/0x5d2988b0929d08e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbec3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599622.086715:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e4000/0x5d2988b0929d08e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbec3 expref: 6 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599622.086727:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e4000/0x5d2988b0929d08e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbec3 expref: 6 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599622.086737:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4000, rc 0) 00000100:00100000:3.0:1787599622.086841:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+6:14900:x1874433559086848:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 189us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599622.086849:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1787599622.089897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.089995:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559086976 00000100:00100000:3.0:1787599622.090006:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559086976 00000100:00100000:3.0:1787599622.090066:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1787599622.090077:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+6:14900:x1874433559086976:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787599622.090220:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+6:14900:x1874433559086976:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 144us (331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599622.090245:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:0.0:1787599622.106118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.106355:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087104 00000100:00100000:1.0:1787599622.106366:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087104 00000100:00100000:1.0:1787599622.106427:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1787599622.106439:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+6:14900:x1874433559087104:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599622.106455:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599622.106472:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54b800/0x5d2988b0929d08e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbeca expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.106498:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54b800/0x5d2988b0929d08e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeca expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.106509:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54b800/0x5d2988b0929d08e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeca expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.106518:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54b800, rc 0) 00000100:00100000:1.0:1787599622.106633:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+7:14900:x1874433559087104:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 195us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.106641:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1787599622.121359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.125020:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087232 00000100:00100000:2.0:1787599622.125043:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087232 00000100:00100000:2.0:1787599622.125136:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1787599622.125148:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+7:14900:x1874433559087232:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599622.125369:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+8:14900:x1874433559087232:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 222us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.125400:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1787599622.127601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.127703:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087360 00000100:00100000:1.0:1787599622.127713:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087360 00000100:00100000:1.0:1787599622.127785:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1787599622.127990:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+8:14900:x1874433559087360:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599622.128141:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+8:14900:x1874433559087360:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 346us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.128149:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1787599622.130590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.131035:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087488 00000100:00100000:1.0:1787599622.131046:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087488 00000100:00100000:1.0:1787599622.131103:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1787599622.131115:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087488:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599622.131561:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087488:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 447us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.131570:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1787599622.159907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.160038:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087616 00000100:00100000:1.0:1787599622.160048:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087616 00000100:00100000:1.0:1787599622.160150:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1787599622.160171:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087616:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599622.161513:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087616:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 1345us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.161526:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1787599622.174871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.174976:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087744 00000100:00100000:2.0:1787599622.174989:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087744 00000100:00100000:2.0:1787599622.175051:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1787599622.175061:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087744:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599622.175226:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+8:14919:x1874433559087744:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 165us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.175234:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1787599622.178592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.178685:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559087872 00000100:00100000:1.0:1787599622.178694:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559087872 00000100:00100000:1.0:1787599622.178752:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:1.0:1787599622.178772:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+8:14900:x1874433559087872:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599622.178823:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599622.178843:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54aa00/0x5d2988b0929d08ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbefb expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.178889:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54aa00/0x5d2988b0929d08ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbefb expref: 9 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.178900:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54aa00/0x5d2988b0929d08ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbefb expref: 9 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599622.178909:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54aa00, rc 0) 00000100:00100000:1.0:1787599622.178981:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+9:14900:x1874433559087872:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 219us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.178989:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1787599622.182137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.182223:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088000 00000100:00100000:3.0:1787599622.182234:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088000 00000100:00100000:3.0:1787599622.182296:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:3.0:1787599622.182309:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+9:14900:x1874433559088000:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787599622.182336:0:17092:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787599622.182362:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787599622.182367:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787599622.182369:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787599622.182372:0:17092:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787599622.182374:0:17092:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787599622.185672:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+9:14900:x1874433559088000:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 3350us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599622.185688:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1787599622.189399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.189597:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088128 00000100:00100000:2.0:1787599622.189607:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088128 00000100:00100000:2.0:1787599622.189714:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1787599622.189726:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+9:14900:x1874433559088128:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599622.189744:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599622.189761:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbf02 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.189862:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.189874:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.189884:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759600, rc 0) 00000100:00100000:2.0:1787599622.189934:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+10:14900:x1874433559088128:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 211us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.189941:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1787599622.192124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.192217:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088256 00000100:00100000:3.0:1787599622.192226:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088256 00000100:00100000:3.0:1787599622.192280:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1787599622.192289:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+10:14900:x1874433559088256:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787599622.192432:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+10:14900:x1874433559088256:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 143us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599622.192440:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1787599622.194129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.194383:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088384 00000100:00100000:2.0:1787599622.194394:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088384 00000100:00100000:2.0:1787599622.194445:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1787599622.194455:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+10:14900:x1874433559088384:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787599622.194631:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f82bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+10:14900:x1874433559088384:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 177us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.194640:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1787599622.196989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.197218:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088512 00000100:00100000:3.0:1787599622.197229:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088512 00000100:00100000:3.0:1787599622.197292:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:3.0:1787599622.197302:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+10:14924:x1874433559088512:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599622.197443:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+10:14924:x1874433559088512:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 142us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599622.197457:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1787599622.203557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.203910:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088640 00000100:00100000:2.0:1787599622.203921:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088640 00000100:00100000:2.0:1787599622.203982:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1787599622.203992:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+10:14924:x1874433559088640:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599622.204144:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+10:14924:x1874433559088640:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 153us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.204152:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:0.0:1787599622.209231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599622.209333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.214097:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088768 00000100:00100000:3.0:1787599622.214113:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088768 00000100:00100000:2.0:1787599622.219337:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089024 00000100:00100000:2.0:1787599622.219356:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089024 00000100:00100000:2.0:1787599622.219420:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599622.219429:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433559089024:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787599622.219464:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 61197e0d-f8b1-498d-a559-d8255f02ecf0@192.168.202.1@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1787599622.219519:0:17099:0:(genops.c:1385:class_connect()) connect: client 61197e0d-f8b1-498d-a559-d8255f02ecf0, cookie 0x5d2988b0929d08fc 00000004:00100000:2.0:1787599622.219545:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787599622.219809:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599622.221285:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2402:x1874433559089024:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 1851us (11946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.221295:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599622.221338:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1787599622.221345:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433559088768:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787599622.221367:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 61197e0d-f8b1-498d-a559-d8255f02ecf0@192.168.202.1@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1787599622.221413:0:17099:0:(genops.c:1385:class_connect()) connect: client 61197e0d-f8b1-498d-a559-d8255f02ecf0, cookie 0x5d2988b0929d0903 00000004:00100000:2.0:1787599622.221432:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787599622.221635:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b34e547800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599622.221662:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2402:x1874433559088768:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 316us (12442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.221669:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1787599622.227279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.227325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.227357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599622.227536:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089152 00000100:00100000:1.0:1787599622.227546:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089152 00000100:00100000:1.0:1787599622.227607:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559088896 00000100:00100000:1.0:1787599622.227611:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559088896 00000100:00100000:1.0:1787599622.227625:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089280 00000100:00100000:1.0:1787599622.227627:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089280 00000100:00100000:1.0:1787599622.227642:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599622.227652:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:0:x1874433559089152:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599622.227687:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599622.227776:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:0:x1874433559089152:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.227784:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599622.227826:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1787599622.227833:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:0:x1874433559088896:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599622.227851:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787599622.227888:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:0:x1874433559088896:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 56us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.227908:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1787599622.227920:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1787599622.227938:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089280:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599622.227951:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787599622.227973:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089280:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.227979:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00080000:3.0:1787599622.228097:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599622.228102:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599622.236721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.236930:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089408 00000100:00100000:2.0:1787599622.236941:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089408 00000100:00100000:2.0:1787599622.237006:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1787599622.237017:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089408:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787599622.237099:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089408:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.237106:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599622.244671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.244728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599622.244754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.244832:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089792 00000100:00100000:2.0:1787599622.244846:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089792 00000100:00100000:2.0:1787599622.244908:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1787599622.244919:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089792:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787599622.245019:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089792:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 101us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.245028:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1787599622.245034:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089536 00000100:00100000:1.0:1787599622.245039:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089536 00000100:00100000:1.0:1787599622.245058:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089664 00000100:00100000:1.0:1787599622.245061:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089664 00000100:00100000:1.0:1787599622.245102:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599622.245109:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559089536:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599622.245133:0:18992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 61197e0d-f8b1-498d-a559-d8255f02ecf0@192.168.202.1@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1787599622.245174:0:18992:0:(genops.c:1385:class_connect()) connect: client 61197e0d-f8b1-498d-a559-d8255f02ecf0, cookie 0x5d2988b0929d090a 00002000:00100000:1.0:1787599622.245196:0:18992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 61197e0d-f8b1-498d-a559-d8255f02ecf0/ffff96b244234800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599622.245213:0:18992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599622.245693:0:18992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599622.245721:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b244235000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599622.245758:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2402:x1874433559089536:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 648us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.245780:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599622.245837:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599622.245843:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559089664:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599622.245869:0:18992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 61197e0d-f8b1-498d-a559-d8255f02ecf0@192.168.202.1@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1787599622.245885:0:18992:0:(genops.c:1385:class_connect()) connect: client 61197e0d-f8b1-498d-a559-d8255f02ecf0, cookie 0x5d2988b0929d0911 00002000:00100000:1.0:1787599622.245891:0:18992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 61197e0d-f8b1-498d-a559-d8255f02ecf0/ffff96b244237000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599622.245902:0:18992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599622.246018:0:18992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599622.246046:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b34e509800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599622.246072:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2402:x1874433559089664:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 228us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.246080:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1787599622.260842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599622.260957:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559089920 00000100:00100000:0.0:1787599622.260968:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559089920 00000100:00100000:0.0:1787599622.261022:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1787599622.261033:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089920:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787599622.265026:0:17100:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3912us 00000004:00200000:0.0:1787599622.285247:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787599622.285377:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14900:x1874433559089920:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 24340us (24578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599622.285388:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1787599622.519054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599622.519160:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090048 00000100:00100000:2.0:1787599622.519172:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090048 00000100:00100000:2.0:1787599622.519259:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1787599622.519271:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14947:x1874433559090048:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:2.0:1787599622.519293:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599622.519574:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929d0918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbf33 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.519652:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.519666:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.519682:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599622.520249:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599622.520256:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599622.520302:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.521518:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929d0918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf33 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.521553:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf33 expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599622.521564:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:2.0:1787599622.521567:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599622.521570:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759a00, rc 0) 00000100:00100000:2.0:1787599622.521662:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:14947:x1874433559090048:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 2392us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599622.521686:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:0.0:1787599622.636034:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599622.693399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599622.693477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599622.693652:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047232 00000100:00100000:1.0:1787599622.693661:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047232 00000100:00100000:1.0:1787599622.693733:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599622.693744:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599622.693779:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599622.693846:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599622.693853:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787599622.693916:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599622.693953:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047232:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787599623.205520:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787599623.205745:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578047360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599623.205874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599623.205956:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047360 00000100:00100000:0.0:1787599623.205963:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047360 00000100:00100000:0.0:1787599623.206008:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599623.206019:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578047360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599623.206056:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787599623.206099:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578047360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599623.206108:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599623.206150:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578047360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599623.206164:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599623.206170:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578047488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599623.206195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.206323:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047488 00000100:00100000:3.0:1787599623.206329:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047488 00000100:00100000:3.0:1787599623.206366:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599623.206377:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578047488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599623.206392:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787599623.206433:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578047488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.206440:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787599623.206892:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599623.206905:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047744:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.206937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.206947:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578047616:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.206978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578048256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599623.207009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.207035:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578048128:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207037:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578048768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599623.207077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.207092:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578048640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207120:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578047872:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599623.207153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.207187:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048256 00000100:00100000:3.0:1787599623.207192:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048256 00000100:00100000:0.0:1787599623.207198:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578048384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207220:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048768 00000100:00100000:3.0:1787599623.207224:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048768 00000100:00100000:0.0:1787599623.207226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.207257:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048640 00000100:00100000:0.0:1787599623.207258:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578047488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599623.207261:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048640 00000100:00100000:3.0:1787599623.207280:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048384 00000100:00100000:0.0:1787599623.207281:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787599623.207283:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048384 00000100:00100000:0.0:1787599623.207290:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578048000:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207303:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599623.207311:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578048256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599623.207348:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578048512:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207367:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578048256:12345-0@lo:400:kworker.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207378:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599623.207382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.207396:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048000 00000100:00100000:3.0:1787599623.207400:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048000 00000100:00100000:3.0:1787599623.207415:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048512 00000100:00100000:3.0:1787599623.207418:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048512 00000100:00080000:0.0:1787599623.207426:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599623.207431:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599623.207436:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599623.207444:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578048768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207451:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599623.207464:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578048640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207483:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578048768:12345-0@lo:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207490:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599623.207508:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599623.207514:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578048640:12345-0@lo:400:kworker.0 Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207519:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578048384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207528:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599623.207549:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599623.207560:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578048000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207561:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578048384:12345-0@lo:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207572:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599623.207597:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599623.207603:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578048000:12345-0@lo:400:kworker.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207608:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578048512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207615:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599623.207647:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578048000:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207650:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578048512:12345-0@lo:400:kworker.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.207659:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787599623.207666:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2440ece00 x1874433578048512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599623.207677:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578048512:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207694:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578048640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.207707:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578048384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599623.207726:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578048256:0@lo:400:kworker.0 00010000:00080000:3.0:1787599623.207744:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2440ec700 x1874433578048768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599623.207754:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578048768:0@lo:400:kworker.0 00000100:00100000:1.0:1787599623.208092:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047616 00000100:00100000:1.0:1787599623.208097:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047616 00000100:00100000:1.0:1787599623.208131:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599623.208139:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3645:x1874433578047616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599623.208196:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3645:x1874433578047616:12345-0@lo:400:kworker.0 Request processed in 58us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599623.208212:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599623.208243:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048128 00000100:00100000:1.0:1787599623.208247:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048128 00000100:00100000:1.0:1787599623.208278:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047872 00000100:00100000:1.0:1787599623.208281:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047872 00000100:00100000:1.0:1787599623.208313:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599623.208320:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578048128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599623.208352:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578048128:12345-0@lo:400:kworker.0 Request processed in 33us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599623.208358:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599623.208368:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599623.208374:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433578047872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599623.208401:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433578047872:12345-0@lo:400:kworker.0 Request processed in 28us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599623.208407:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787599623.208427:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599623.208430:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599623.208458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578047616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599623.208470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578048128:0@lo:400:kworker.0 00000100:00100000:0.0:1787599623.208643:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578047872:0@lo:400:kworker.0 00000100:00100000:2.0:1787599623.208775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599623.208787:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578048896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599623.208876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599623.208913:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578047744 00000100:00100000:2.0:1787599623.208913:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578048896 00000100:00100000:2.0:1787599623.208918:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578048896 00000100:00100000:3.0:1787599623.208921:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578047744 00000100:00100000:2.0:1787599623.208950:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599623.208961:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578048896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599623.208963:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599623.208977:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047744:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787599623.208982:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787599623.209020:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578048896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599623.209027:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599623.209081:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578048896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599623.209300:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578047744:12345-0@lo:400:kworker.0 Request processed in 326us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.209307:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787599623.213407:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578047744:0@lo:400:kworker.0 00010000:00010000:2.0:1787599623.655735:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599623.717253:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599623.717347:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578049024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599623.717419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599623.717535:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049024 00000100:00100000:2.0:1787599623.717543:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049024 00000100:00100000:3.0:1787599623.717580:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599623.717594:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578049152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599623.717610:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599623.717621:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578049024:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599623.717644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1787599623.717669:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599623.717691:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049152 00000100:00100000:3.0:1787599623.717696:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049152 00000100:00100000:2.0:1787599623.717726:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578049024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599623.717736:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599623.717744:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599623.717781:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578049152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599623.717816:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578049024:0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1787599623.717835:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599623.717883:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578049152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599623.717890:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599623.718153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b38138c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578049152:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1787599624.239121:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000001:00080000:1.0:1787599624.239142:0:19420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1787599624.608995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599624.609326:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090176 00000100:00100000:0.0:1787599624.609337:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090176 00000100:00100000:0.0:1787599624.609428:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1787599624.609438:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:14999:x1874433559090176:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:0.0:1787599624.609479:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787599624.609576:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:14999:x1874433559090176:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 139us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599624.609585:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:2.0:1787599624.609858:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599624.611848:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599624.611945:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090304 00000100:00100000:2.0:1787599624.611959:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090304 00000100:00100000:2.0:1787599624.612049:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599624.612070:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14999:x1874433559090304:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:2.0:1787599624.612121:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599624.612225:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14999:x1874433559090304:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 165us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599624.612233:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:1.0:1787599624.612778:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599624.619701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599624.620365:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090432 00000100:00100000:3.0:1787599624.620378:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090432 00000100:00100000:3.0:1787599624.620534:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1787599624.620548:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14999:x1874433559090432:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1787599624.620581:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599624.620708:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:14999:x1874433559090432:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 163us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599624.620717:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:1.0:1787599624.627471:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599624.629357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599624.629533:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090560 00000100:00100000:3.0:1787599624.629548:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090560 00000100:00100000:3.0:1787599624.629630:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1787599624.629641:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:14999:x1874433559090560:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1787599624.629679:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787599624.629817:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:14999:x1874433559090560:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 177us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599624.629826:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:1.0:1787599624.630085:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787599624.679005:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599624.902818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599624.902899:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090688 00000100:00100000:3.0:1787599624.902915:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090688 00000100:00100000:3.0:1787599624.902961:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:3.0:1787599624.902968:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+10:15031:x1874433559090688:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787599624.903004:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599624.903019:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5800/0x5d2988b0929d0926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbf3a expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599624.903043:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5800/0x5d2988b0929d0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf3a expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599624.903051:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5800/0x5d2988b0929d0926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf3a expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599624.903059:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5800, rc 0) 00000100:00100000:3.0:1787599624.903118:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559090688:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 151us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599624.903123:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1787599624.928625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599624.928823:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090816 00000100:00100000:2.0:1787599624.928842:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090816 00000100:00100000:2.0:1787599624.928898:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1787599624.928908:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559090816:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599624.929060:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559090816:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 153us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599624.929067:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1787599624.933458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599624.933552:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559090944 00000100:00100000:3.0:1787599624.933563:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559090944 00000100:00100000:3.0:1787599624.933629:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1787599624.933640:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559090944:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787599624.933822:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559090944:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 183us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599624.933831:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:0.0:1787599624.939398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599624.942993:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091072 00000100:00100000:1.0:1787599624.943025:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091072 00000100:00100000:1.0:1787599624.943097:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1787599624.943109:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091072:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599624.943271:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091072:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 163us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599624.943279:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:0.0:1787599625.005733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.015624:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091200 00000100:00100000:2.0:1787599625.015642:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091200 00000100:00100000:2.0:1787599625.015718:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:2.0:1787599625.015730:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091200:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599625.015946:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091200:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 216us (10221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.015954:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1787599625.025490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.025737:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091328 00000100:00100000:1.0:1787599625.025756:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091328 00000100:00100000:1.0:1787599625.025837:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:1.0:1787599625.025848:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091328:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599625.026021:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+11:15038:x1874433559091328:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 174us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.026030:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1787599625.035926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599625.036119:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091456 00000100:00100000:3.0:1787599625.036129:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091456 00000100:00100000:3.0:1787599625.036184:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:3.0:1787599625.036195:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+11:15031:x1874433559091456:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787599625.036211:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599625.036242:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5a00/0x5d2988b0929d092d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbf6b expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.036443:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5a00/0x5d2988b0929d092d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf6b expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.036457:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5a00/0x5d2988b0929d092d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf6b expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.036477:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5a00, rc 0) 00000100:00100000:3.0:1787599625.036541:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+12:15031:x1874433559091456:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 348us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599625.036548:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1787599625.046878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.046993:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091584 00000100:00100000:2.0:1787599625.047005:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091584 00000100:00100000:2.0:1787599625.047068:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:2.0:1787599625.047216:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:15031:x1874433559091584:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787599625.047247:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787599625.047276:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787599625.047281:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787599625.047284:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787599625.047288:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787599625.047290:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787599625.056476:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:15031:x1874433559091584:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 9245us (9589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.066394:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1787599625.068521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599625.069773:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091712 00000100:00100000:3.0:1787599625.069788:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091712 00000100:00100000:3.0:1787599625.069888:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1787599625.069898:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+12:15031:x1874433559091712:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787599625.069916:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599625.069936:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbf72 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.069964:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 13 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.069974:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 13 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599625.069996:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5200, rc 0) 00000100:00100000:3.0:1787599625.070064:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3810e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:15031:x1874433559091712:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 167us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599625.070450:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1787599625.073968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.075649:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091840 00000100:00100000:2.0:1787599625.075665:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091840 00000100:00100000:2.0:1787599625.075759:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:2.0:1787599625.075771:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:15031:x1874433559091840:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599625.075998:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:15031:x1874433559091840:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 230us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.076007:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:0.0:1787599625.082450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.082550:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559091968 00000100:00100000:1.0:1787599625.082563:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559091968 00000100:00100000:1.0:1787599625.082633:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1787599625.082643:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:15031:x1874433559091968:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599625.082839:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:15031:x1874433559091968:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 197us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.082847:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1787599625.093310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599625.093498:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092096 00000100:00100000:3.0:1787599625.093510:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092096 00000100:00100000:3.0:1787599625.093572:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:3.0:1787599625.093583:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:15042:x1874433559092096:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599625.093763:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:15042:x1874433559092096:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 181us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599625.093772:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1787599625.103312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.104058:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092224 00000100:00100000:2.0:1787599625.104068:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092224 00000100:00100000:2.0:1787599625.104296:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1787599625.104308:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:15042:x1874433559092224:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599625.104464:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:15042:x1874433559092224:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 158us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.104473:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1787599625.109991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599625.110247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.110440:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092352 00000100:00100000:2.0:1787599625.110452:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092352 00000100:00100000:2.0:1787599625.110514:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092608 00000100:00100000:2.0:1787599625.110518:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092608 00000100:00100000:2.0:1787599625.110547:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599625.110556:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433559092352:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787599625.110586:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd7a1775-f008-45c6-8360-bad6104f0230@192.168.202.1@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787599625.110644:0:17099:0:(genops.c:1385:class_connect()) connect: client dd7a1775-f008-45c6-8360-bad6104f0230, cookie 0x5d2988b0929d093b 00000004:00100000:2.0:1787599625.110673:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787599625.110811:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b34e540800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599625.110875:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2402:x1874433559092352:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 319us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.110884:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599625.110912:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599625.110917:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433559092608:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787599625.110933:0:17099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dd7a1775-f008-45c6-8360-bad6104f0230@192.168.202.1@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787599625.110956:0:17099:0:(genops.c:1385:class_connect()) connect: client dd7a1775-f008-45c6-8360-bad6104f0230, cookie 0x5d2988b0929d0942 00000004:00100000:2.0:1787599625.110967:0:17099:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787599625.111017:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b34e545000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599625.111039:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2402:x1874433559092608:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 121us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.111045:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1787599625.117295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599625.117348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599625.117472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.118257:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092736 00000100:00100000:1.0:1787599625.118269:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092736 00000100:00100000:3.0:1787599625.118332:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092480 00000100:00100000:3.0:1787599625.118337:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092480 00000100:00100000:1.0:1787599625.118401:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092864 00000100:00100000:1.0:1787599625.118405:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092864 00000100:00100000:1.0:1787599625.118423:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1787599625.118432:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:0:x1874433559092736:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599625.118479:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599625.118557:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:0:x1874433559092736:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 124us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.118564:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1787599625.118582:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599625.118588:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+7:15031:x1874433559092864:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599625.118621:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787599625.118650:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+7:15031:x1874433559092864:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 62us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.118656:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00080000:0.0:1787599625.119574:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599625.119580:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599625.120110:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599625.120123:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:0:x1874433559092480:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599625.120146:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787599625.120203:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:0:x1874433559092480:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 84us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.120210:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1787599625.129897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.130158:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559092992 00000100:00100000:1.0:1787599625.130169:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559092992 00000100:00100000:1.0:1787599625.130271:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599625.130281:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559092992:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787599625.130378:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559092992:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 98us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.130385:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599625.139177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.139229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.139262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599625.139402:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093120 00000100:00100000:2.0:1787599625.139413:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093120 00000100:00100000:2.0:1787599625.139455:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093248 00000100:00100000:2.0:1787599625.139459:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093248 00000100:00100000:2.0:1787599625.139482:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599625.139490:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559093120:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787599625.139534:0:18992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd7a1775-f008-45c6-8360-bad6104f0230@192.168.202.1@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787599625.139567:0:18992:0:(genops.c:1385:class_connect()) connect: client dd7a1775-f008-45c6-8360-bad6104f0230, cookie 0x5d2988b0929d0949 00002000:00100000:2.0:1787599625.139578:0:18992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd7a1775-f008-45c6-8360-bad6104f0230/ffff96b34e542000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599625.139591:0:18992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599625.139688:0:18992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599625.139728:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b34e544800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599625.139831:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+6:2402:x1874433559093120:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 340us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.139840:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599625.139858:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1787599625.139863:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559093248:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787599625.139881:0:18992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd7a1775-f008-45c6-8360-bad6104f0230@192.168.202.1@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787599625.139896:0:18992:0:(genops.c:1385:class_connect()) connect: client dd7a1775-f008-45c6-8360-bad6104f0230, cookie 0x5d2988b0929d0950 00002000:00100000:2.0:1787599625.139902:0:18992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd7a1775-f008-45c6-8360-bad6104f0230/ffff96b34e542800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599625.139907:0:18992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599625.139951:0:18992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787599625.139964:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b34e544000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599625.140000:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+6:2402:x1874433559093248:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 135us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599625.140006:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1787599625.142847:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093376 00000100:00100000:3.0:1787599625.142864:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093376 00000100:00100000:3.0:1787599625.142952:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599625.142963:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559093376:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787599625.143064:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559093376:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 104us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599625.143073:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599625.153137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599625.153655:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093504 00000100:00100000:3.0:1787599625.153674:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093504 00000100:00100000:3.0:1787599625.153985:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1787599625.153999:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559093504:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787599625.154108:0:17101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787599625.154218:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:15031:x1874433559093504:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 222us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599625.154227:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1787599625.387022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599625.387116:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093632 00000100:00100000:1.0:1787599625.387125:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093632 00000100:00100000:1.0:1787599625.387179:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1787599625.387187:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:15065:x1874433559093632:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:1.0:1787599625.387208:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599625.387232:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfa3 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387319:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387331:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387343:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599625.387383:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787599625.387386:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599625.387402:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387422:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 8 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387435:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599625.387458:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:1.0:1787599625.387461:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599625.387463:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a400, rc 0) 00000100:00100000:1.0:1787599625.387517:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+7:15065:x1874433559093632:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 331us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599625.387522:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:2.0:1787599625.701149:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599626.725736:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599627.751189:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599627.813512:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578049280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599627.813586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599627.813822:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049280 00000100:00100000:2.0:1787599627.813845:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049280 00000100:00100000:2.0:1787599627.813918:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599627.813928:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578049280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599627.813957:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599627.814011:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578049280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599627.814018:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599627.814056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578049280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599627.814342:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599628.325351:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599628.325378:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578049408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599628.325453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326314:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578049536:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326352:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326376:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578050048:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578050560:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326467:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787599628.326471:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578049920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326502:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578050432:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326536:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578049664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578050176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578050688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326636:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787599628.326641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578049792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326672:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578050304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326694:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578050816:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599628.326740:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050048 00000100:00100000:0.0:1787599628.326746:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050048 00000100:00100000:0.0:1787599628.326811:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050176 00000100:00100000:0.0:1787599628.326814:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050176 00000100:00100000:0.0:1787599628.326836:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599628.326844:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578050048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326891:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578050048:12345-0@lo:400:kworker.0 Request processed in 47us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.326898:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599628.326912:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599628.326917:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.326940:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578050176:12345-0@lo:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.326945:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599628.326959:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050560 00000100:00100000:0.0:1787599628.326962:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050560 00000100:00100000:0.0:1787599628.326986:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050432 00000100:00100000:0.0:1787599628.326988:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050432 00000100:00100000:0.0:1787599628.326997:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050688 00000100:00100000:0.0:1787599628.326999:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050688 00000100:00100000:0.0:1787599628.327009:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049792 00000100:00100000:0.0:1787599628.327011:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049792 00000100:00100000:0.0:1787599628.327021:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050304 00000100:00100000:0.0:1787599628.327023:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050304 00000100:00100000:0.0:1787599628.327030:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050816 00000100:00100000:0.0:1787599628.327032:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050816 00000100:00100000:0.0:1787599628.327042:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599628.327047:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327075:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578050560:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327081:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599628.327092:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599628.327098:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433578050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327122:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433578050432:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327128:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599628.327140:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599628.327146:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327171:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578050688:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327177:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599628.327188:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599628.327193:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578049792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327220:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578049792:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327232:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599628.327244:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599628.327250:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327276:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578050304:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327282:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599628.327292:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599628.327298:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327322:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578050816:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327328:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599628.327345:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049920 00000100:00100000:0.0:1787599628.327349:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049920 00000100:00100000:0.0:1787599628.327364:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049664 00000100:00100000:0.0:1787599628.327366:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049664 00000100:00100000:0.0:1787599628.327377:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599628.327383:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578049920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327413:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578049920:12345-0@lo:400:kworker.0 Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327419:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599628.327430:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599628.327436:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578049664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327459:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578049664:12345-0@lo:400:kworker.0 Request processed in 24us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599628.327464:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787599628.327497:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599628.327502:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599628.327504:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599628.327505:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599628.327540:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578049792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327550:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578050304:0@lo:400:kworker.0 00010000:00080000:0.0:1787599628.327560:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243757b80 x1874433578050816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599628.327571:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578050816:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327579:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578049664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327588:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578050176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327595:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578050688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327629:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578049920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327639:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578050432:0@lo:400:kworker.0 00000100:00100000:0.0:1787599628.327647:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578050048:0@lo:400:kworker.0 00010000:00080000:0.0:1787599628.327656:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243754000 x1874433578050560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599628.327664:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578050560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599628.327986:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599628.327996:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599628.328029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599628.328075:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578050944 00000100:00100000:2.0:1787599628.328079:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578050944 00000100:00100000:2.0:1787599628.328108:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599628.328115:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578050944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599628.328141:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787599628.328177:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578050944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599628.328182:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599628.328216:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599628.333750:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578051072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599628.334166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1787599628.341567:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:0.0:1787599628.341584:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000100:00100000:2.0:1787599628.345002:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049536 00000100:00100000:2.0:1787599628.345020:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049536 00000100:00100000:2.0:1787599628.345098:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787599628.345109:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3648:x1874433578049536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599628.345224:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3648:x1874433578049536:12345-0@lo:400:kworker.0 Request processed in 117us (18870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599628.345250:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000001:00100000:2.0:1787599628.345957:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:2.0:1787599628.345971:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000100:00100000:3.0:1787599628.350696:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578049536:0@lo:400:kworker.0 00000100:00100000:1.0:1787599628.354239:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578049408 00000100:00100000:1.0:1787599628.354259:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578049408 00000100:00100000:1.0:1787599628.354359:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051072 00000100:00100000:1.0:1787599628.354363:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051072 00000100:00100000:1.0:1787599628.354385:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599628.354395:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578049408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599628.354440:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787599628.354532:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578049408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (29078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599628.354539:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599628.354558:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599628.354565:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578051072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599628.354575:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787599628.354602:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578051072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (20437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599628.354608:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787599628.354755:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599628.355328:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578051072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599628.355343:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787599628.355362:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578049408:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787599628.359362:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:1.0:1787599628.359376:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000001:02000400:3.0:1787599628.510438:0:19976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787599628.777437:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599628.837112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578051200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599628.837205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599628.839117:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051200 00000100:00100000:1.0:1787599628.839134:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051200 00000100:00100000:1.0:1787599628.839213:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599628.839224:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578051200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599628.839273:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599628.839372:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578051200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599628.839380:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599628.839430:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578051200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599628.839758:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599628.839785:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578051328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599628.839861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599628.840165:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051328 00000100:00100000:1.0:1787599628.840171:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051328 00000100:00100000:1.0:1787599628.840212:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599628.840220:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578051328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599628.840237:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599628.840285:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578051328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599628.840291:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599628.840377:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578051328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787599629.796996:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599630.279959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599630.280027:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093888 00000100:00100000:1.0:1787599630.280039:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093888 00000100:00100000:0.0:1787599630.280040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599630.280115:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094400 00000100:00100000:1.0:1787599630.280121:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094400 00000100:00100000:0.0:1787599630.280132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599630.280180:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094144 00000100:00100000:3.0:1787599630.280185:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094144 00000100:00100000:3.0:1787599630.280228:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094656 00000100:00100000:3.0:1787599630.280232:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094656 00000100:00100000:3.0:1787599630.280257:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1787599630.280267:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599630.280315:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094016 00000100:00100000:1.0:1787599630.280320:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094016 00000100:00100000:1.0:1787599630.280344:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1787599630.280352:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2405:x1874433559093888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599630.280360:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599630.280368:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1787599630.280388:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599630.280393:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2405:x1874433559093888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599630.280399:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559094656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599630.280415:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1787599630.280431:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559094656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599630.280437:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599630.280448:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1787599630.280458:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559094400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:3.0:1787599630.280460:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787599630.280465:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599630.280467:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599630.280875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599630.280943:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094528 00000100:00100000:0.0:1787599630.280948:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094528 00000100:00100000:0.0:1787599630.280979:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1787599630.280988:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599630.281027:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599630.281033:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1787599630.281047:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1787599630.281054:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559094528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599630.281080:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559094528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599630.281087:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1787599630.281106:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094272 00000100:00100000:0.0:1787599630.281109:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094272 00000100:00100000:0.0:1787599630.281128:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094784 00000100:00100000:0.0:1787599630.281131:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094784 00000100:00100000:0.0:1787599630.281145:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1787599630.281152:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599630.281188:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559094272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599630.281195:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1787599630.281208:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599630.281215:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559094784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599630.281236:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559094784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599630.281243:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599630.281263:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559093760 00000100:00100000:0.0:1787599630.281267:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559093760 00000100:00100000:1.0:1787599630.281590:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559094400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599630.281597:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00080000:3.0:1787599630.281654:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599630.281659:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787599630.282161:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1787599630.282172:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559093760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599630.282214:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559093760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599630.282221:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000040:00080000:1.0:1787599630.501627:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599630.821016:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599631.402639:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00010000:00010000:0.0:1787599631.848304:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599631.942317:0:20124:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe81104630 20000000:00000080:3.0:1787599631.942335:0:20124:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b344bd7400 uarg=0000000000000000 20000000:01000000:3.0:1787599631.942375:0:20124:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599631.942381:0:20124:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599631.942385:0:20124:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787599631.943019:0:20125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787599631.943191:0:20124:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787599631.957426:0:20124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787599631.957462:0:20124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957482:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957489:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957496:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957503:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d079e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957513:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957520:0:20124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957528:0:20124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957574:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.957601:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 12 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.957615:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051456:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599631.958472:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.958485:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 12 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.958494:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051584:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599631.958536:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.958544:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 23 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.958554:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051712:0@lo:104: 00000100:00100000:3.0:1787599631.958593:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599631.958634:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.958642:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 23 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.958650:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051840:0@lo:104: 00000100:00100000:3.0:1787599631.958675:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599631.958740:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.958748:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 23 pid: 17091 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.958756:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051968:0@lo:104: 00000100:00100000:0.0:1787599631.958852:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051712 00000100:00100000:0.0:1787599631.958861:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051712 00000100:00100000:0.0:1787599631.958903:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051840 00000100:00100000:0.0:1787599631.958907:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051840 00000100:00100000:0.0:1787599631.958921:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599631.958929:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:20124:x1874433578051712:12345-0@lo:104: 00010000:00010000:0.0:1787599631.958942:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959012:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599631.959020:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:20124:x1874433578051712:12345-0@lo:104: Request processed in 91us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599631.959026:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599631.959044:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599631.959051:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:20124:x1874433578051840:12345-0@lo:104: 00010000:00010000:0.0:1787599631.959058:0:17081:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959101:0:17081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599631.959106:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:20124:x1874433578051840:12345-0@lo:104: Request processed in 56us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599631.959111:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787599631.959128:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599631.959133:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959140:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599631.959144:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959152:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599631.959159:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599631.959165:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599631.959199:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959205:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599631.959223:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959229:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d079e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d07a5 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959400:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599631.959405:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959411:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599631.959413:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959420:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599631.959426:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599631.959431:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599631.959445:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959450:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599631.959457:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959472:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243759e00/0x5d2988b0929d0640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0647 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.959482:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599631.959483:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599631.959485:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599631.959492:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599631.959510:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578052096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599631.959537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599631.960206:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599631.960214:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578052224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599631.960481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599631.960517:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599631.960634:0:20124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.960647:0:20124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.960657:0:20124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578052352:0@lo:104: 00000100:00100000:0.0:1787599631.960690:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052096 00000100:00100000:3.0:1787599631.960695:0:20124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599631.960697:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052096 00000100:00100000:3.0:1787599631.960710:0:20124:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce480 going to sleep for 11 seconds 00010000:00010000:0.0:1787599631.960719:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 24 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.960728:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051712:0@lo:104: 00000100:00100000:3.0:1787599631.960737:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051840:0@lo:104: 00000100:00100000:0.0:1787599631.960737:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052224 00000100:00100000:0.0:1787599631.960740:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052224 00010000:00010000:0.0:1787599631.960749:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 25 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599631.960777:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599631.960786:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+25:3647:x1874433578052096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599631.960812:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599631.960818:0:17853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 25 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.960841:0:17853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 25 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.960851:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787599631.960868:0:17853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200da00/0x5d2988b0929d07a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d079e expref: 25 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.960882:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599631.960915:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3647:x1874433578052096:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599631.961121:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3647:x1874433578052224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599631.961131:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599631.961136:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 24 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.961145:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 24 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.961155:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200d800/0x5d2988b0929d0647 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0640 expref: 24 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.961171:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599631.961208:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:3647:x1874433578052224:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599631.961263:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578051968 00000100:00100000:1.0:1787599631.961268:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578051968 00000100:00100000:1.0:1787599631.961289:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052352 00000100:00100000:1.0:1787599631.961292:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052352 00000100:00100000:1.0:1787599631.961303:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599631.961309:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:20124:x1874433578051968:12345-0@lo:104: 00010000:00010000:1.0:1787599631.961319:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961362:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599631.961367:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+4:20124:x1874433578051968:12345-0@lo:104: Request processed in 59us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599631.961373:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599631.961388:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599631.961394:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:20124:x1874433578052352:12345-0@lo:104: 00010000:00010000:1.0:1787599631.961401:0:17082:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961445:0:17082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599631.961451:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+3:20124:x1874433578052352:12345-0@lo:104: Request processed in 57us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599631.961457:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787599631.961472:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599631.961476:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961483:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599631.961486:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961493:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599631.961499:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599631.961505:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599631.961526:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961532:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599631.961549:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961556:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243759800/0x5d2988b0929d0601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0608 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961579:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599631.961582:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961588:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599631.961591:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961598:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599631.961619:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599631.961624:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599631.961639:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961646:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599631.961652:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961659:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c200/0x5d2988b0929d05f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d05fa expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.961673:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599631.961675:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599631.961677:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599631.961701:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578052480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599631.961735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599631.961780:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599631.961787:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578052608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599631.961838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599631.961885:0:17084:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787599631.961893:0:17084:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787599631.961980:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599631.962003:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052480 00000100:00100000:1.0:1787599631.962007:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052480 00000100:00100000:2.0:1787599631.962259:0:17083:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787599631.962268:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052608 00000100:00100000:2.0:1787599631.962272:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052608 00010000:00010000:2.0:1787599631.962287:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 25 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.962313:0:17084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 24 pid: 17091 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599631.962808:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599631.962857:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578052224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599631.962868:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578052096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599631.974155:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599631.974252:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051968:0@lo:104: 00000100:00100000:3.0:1787599631.974263:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578052352:0@lo:104: 00000100:00100000:2.0:1787599631.974623:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599631.974639:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:3645:x1874433578052608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599631.974660:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599631.974669:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.974695:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.974732:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a600/0x5d2988b0929d05fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d05f3 expref: 23 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.974748:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599631.974851:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3645:x1874433578052608:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (13012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599631.974870:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599631.975211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578052608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599631.977552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599631.977606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599631.977643:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559094912 00000100:00100000:0.0:1787599631.977652:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559094912 00010000:00010000:0.0:1787599631.977698:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 13 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599631.977730:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095040 00000100:00100000:0.0:1787599631.977734:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095040 00010000:00010000:0.0:1787599631.977745:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 14 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599631.977756:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051456:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599631.977764:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599631.977766:0:20124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20124:1874433578051584:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599631.977772:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10394c45-c749-48e8-b612-3d793d59d9ea+14:2403:x1874433559094912:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599631.977785:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599631.977818:0:20124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.977818:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 14 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.977830:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 14 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599631.977908:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1787599631.977918:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10394c45-c749-48e8-b612-3d793d59d9ea+14:2403:x1874433559095040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599631.977928:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599631.977932:0:17084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 14 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599631.977980:0:20126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599631.977990:0:20126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578052480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599631.977999:0:20126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599631.978033:0:20126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 21 pid: 17091 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.985419:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf72 expref: 14 pid: 17092 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599631.985450:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599631.985532:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10394c45-c749-48e8-b612-3d793d59d9ea+13:2403:x1874433559094912:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 7758us (7989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599631.985542:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:1.0:1787599631.987741:0:17084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 12 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.987771:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759600/0x5d2988b0929d08f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf02 expref: 12 pid: 17090 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599631.987802:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599631.987874:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10394c45-c749-48e8-b612-3d793d59d9ea+11:2403:x1874433559095040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 9957us (10266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599631.987886:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:2.0:1787599631.989341:0:20126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 21 pid: 17091 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989366:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152bc00/0x5d2988b0929d0608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0601 expref: 21 pid: 17091 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989383:0:20126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989392:0:20126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989411:0:20126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989418:0:20126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989438:0:20126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989446:0:20126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989452:0:20126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599631.989456:0:20126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989464:0:20126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989480:0:20126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599631.989492:0:20126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599631.989572:0:20126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:3645:x1874433578052480:12345-0@lo:103:ldlm_bl.0 Request processed in 11583us (27834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599631.989581:0:20126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787599631.989754:0:20124:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.989762:0:20124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599631.989768:0:20124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0965 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599631.991704:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578052480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599632.869073:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599632.933050:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578052736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599632.933125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599632.933430:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052736 00000100:00100000:2.0:1787599632.933439:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052736 00000100:00100000:2.0:1787599632.933518:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599632.933529:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578052736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599632.933561:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787599632.933691:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599632.933774:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578052736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599632.933783:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599632.934018:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578052736:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1787599633.317423:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599633.317432:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37b7a4000 from 13 10000000:01000000:0.0:1787599633.317438:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599633.317497:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.317511:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.317524:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599633.317583:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578052864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.317681:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599633.317728:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599633.317784:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052864 00000100:00100000:3.0:1787599633.317818:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052864 00000100:00100000:3.0:1787599633.317869:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787599633.317880:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:17094:x1874433578052864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599633.317893:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599633.317913:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d096c expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.317939:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d096c expref: 21 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.317950:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d096c expref: 21 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.317959:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5e00, rc 0) 00000100:00100000:3.0:1787599633.318003:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578052864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599633.318010:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787599633.318239:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578052864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599633.318254:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.318264:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599633.318340:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578052992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.318369:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599633.318408:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599633.318550:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578052992 00000100:00100000:3.0:1787599633.318555:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578052992 00000100:00100000:3.0:1787599633.318598:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787599633.318608:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578052992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.318764:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578052992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599633.318772:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787599633.319071:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578052992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.319103:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.319147:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599633.319176:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34542c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599633.319216:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053120 00000100:00100000:3.0:1787599633.319221:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053120 00000100:00100000:3.0:1787599633.319253:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787599633.319261:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578053120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.319355:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578053120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599633.319361:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787599633.319565:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599633.325244:0:20155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599633.334745:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599633.334898:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599633.334911:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.334923:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599633.334964:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599633.334968:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b3440db800 from 13 10000000:01000000:3.0:1787599633.334972:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599633.335024:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.335034:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.335047:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599633.335082:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.335186:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599633.335288:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599633.342291:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053248 00000100:00100000:0.0:1787599633.342313:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053248 00000100:00100000:3.0:1787599633.342773:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787599633.342789:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:17094:x1874433578053248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599633.342844:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599633.342869:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d097a expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.342899:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d097a expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.342927:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d097a expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.342936:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e5200, rc 0) 00000100:00100000:3.0:1787599633.343031:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (7845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599633.343039:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787599633.343099:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599633.343120:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.343132:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599633.343224:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.343265:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599633.343299:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.343377:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053376 00000100:00100000:1.0:1787599633.343395:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053376 00000100:00100000:1.0:1787599633.343444:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787599633.343453:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.343602:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.343611:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787599633.344016:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.344052:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.344107:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599633.344127:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.344268:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053504 00000100:00100000:1.0:1787599633.344273:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053504 00000100:00100000:1.0:1787599633.344309:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787599633.344326:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.344586:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.344603:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787599633.344832:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599633.351508:0:20156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599633.352760:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599633.352819:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599633.352847:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.352858:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599633.352868:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599633.352871:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f890800 from 13 10000000:01000000:3.0:1787599633.352874:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599633.352910:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.352918:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599633.352930:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599633.352959:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599633.353049:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599633.353095:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.353641:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053632 00000100:00100000:1.0:1787599633.353651:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053632 00000100:00100000:1.0:1787599633.353712:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599633.353723:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:17094:x1874433578053632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599633.353738:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599633.353752:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d098f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0988 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.353780:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d098f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0988 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.353817:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d098f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0988 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.353843:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54bc00, rc 0) 00000100:00100000:1.0:1787599633.353905:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578053632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.353911:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599633.353973:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599633.353995:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.354005:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599633.354077:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.354106:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.354131:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b5fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.354144:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053760 00000100:00100000:1.0:1787599633.354148:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053760 00000100:00100000:1.0:1787599633.354173:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787599633.354179:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578053760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.354284:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578053760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.354292:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787599633.354321:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.354346:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.354388:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.354413:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578053888 00000100:00100000:1.0:1787599633.354417:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578053888 00000100:00100000:1.0:1787599633.354444:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787599633.354451:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578053888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.354521:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578053888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.354528:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787599633.354558:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b5fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.354569:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578053888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599633.360415:0:20158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787599633.362473:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787599633.362515:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599633.362529:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.362558:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599633.362571:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599633.362574:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b377a86000 from 13 10000000:01000000:0.0:1787599633.362577:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599633.362636:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.362645:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599633.362658:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599633.362697:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.362788:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.362870:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054016 00000100:00100000:0.0:1787599633.362874:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599633.362883:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054016 00000100:00100000:2.0:1787599633.362962:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787599633.362974:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:17094:x1874433578054016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599633.362987:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599633.363001:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759800/0x5d2988b0929d099d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0996 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.363027:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759800/0x5d2988b0929d099d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0996 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.363038:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759800/0x5d2988b0929d099d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0996 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.363046:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759800, rc 0) 00000100:00100000:2.0:1787599633.363453:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578054016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 479us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599633.363460:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787599633.363634:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599633.363650:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.363660:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599633.363749:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599633.363779:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.363947:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344b59180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599633.364500:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054144 00000100:00100000:0.0:1787599633.364632:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054144 00000100:00100000:0.0:1787599633.364686:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787599633.364696:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578054144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.365058:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578054144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.365066:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787599633.365694:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599633.365747:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599633.365948:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.365997:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344b59180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599633.366433:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054272 00000100:00100000:1.0:1787599633.366442:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054272 00000100:00100000:1.0:1787599633.366490:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787599633.366502:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578054272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599633.366652:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:17094:x1874433578054272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.366662:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787599633.366694:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:17094:1874433578054272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599633.367776:0:20159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787599633.369563:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787599633.369608:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599633.369620:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.369632:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599633.421711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599633.422041:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095168 00000100:00100000:1.0:1787599633.422063:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095168 00000100:00100000:1.0:1787599633.422134:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1787599633.422145:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+11:14915:x1874433559095168:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599633.422163:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599633.422182:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d09a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfaa expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.422216:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d09a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfaa expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.422249:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d09a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfaa expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599633.422259:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ac00, rc 0) 00000100:00100000:1.0:1787599633.422353:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095168:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 209us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.422360:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1787599633.428412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599633.429449:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095296 00000100:00100000:3.0:1787599633.429464:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095296 00000100:00100000:0.0:1787599633.429703:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:0.0:1787599633.429735:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095296:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.431104:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095296:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 1356us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.431118:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:1.0:1787599633.435761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599633.445027:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599633.445100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.445160:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578054528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599633.445200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.445241:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054400 00000100:00100000:1.0:1787599633.445248:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054400 00000100:00100000:1.0:1787599633.445293:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054528 00000100:00100000:1.0:1787599633.445296:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054528 00000100:00100000:1.0:1787599633.445330:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599633.445340:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599633.445370:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787599633.445413:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.445420:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599633.445436:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599633.445442:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578054528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599633.445465:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787599633.445495:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578054528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.445502:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787599633.445521:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599633.445568:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578054528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599633.446730:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599633.446752:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.446810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599633.446978:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054912 00000100:00100000:0.0:1787599633.446985:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054912 00000100:00100000:0.0:1787599633.447024:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599633.447034:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.447081:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054912:12345-0@lo:400:kworker.0 Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.447089:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599633.447694:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.447703:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578055424:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.447740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.447765:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578055936:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.447815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.448959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787599633.448972:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054784:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.449014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.449037:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578055296:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.449060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.449081:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578055808:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.449106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.449288:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095424 00000100:00100000:2.0:1787599633.449297:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095424 00000100:00100000:0.0:1787599633.450454:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054784 00000100:00100000:0.0:1787599633.450465:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054784 00000100:00100000:0.0:1787599633.450535:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787599633.450546:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.451064:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055424 00000100:00100000:1.0:1787599633.451070:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055424 00000100:00100000:1.0:1787599633.451109:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055936 00000100:00100000:0.0:1787599633.451779:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578054784:12345-0@lo:400:kworker.0 Request processed in 1229us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.451789:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000040:00080000:2.0:1787599633.451994:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787599633.452119:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1787599633.452130:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095424:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.452395:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055808 00000100:00100000:0.0:1787599633.452404:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055808 00000100:00100000:0.0:1787599633.452443:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599633.452451:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578055424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.452510:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578055424:12345-0@lo:400:kworker.0 Request processed in 61us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.452516:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599633.452530:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599633.452545:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433578055808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.452578:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433578055808:12345-0@lo:400:kworker.0 Request processed in 35us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.452584:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599633.452749:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055936 00000100:00100000:1.0:1787599633.452776:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599633.452783:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578055936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.452838:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578055936:12345-0@lo:400:kworker.0 Request processed in 49us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.452845:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599633.453808:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055296 00000100:00100000:1.0:1787599633.453819:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055296 00000100:00100000:1.0:1787599633.453864:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599633.453873:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.453927:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578055296:12345-0@lo:400:kworker.0 Request processed in 56us (4866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.453934:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599633.453970:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578054656:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.454011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.454050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578055168:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.454100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.454121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578055680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.454144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.454167:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787599633.454175:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578055040:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.454213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.454230:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578055552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.454253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599633.454268:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578056064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599633.454300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.454502:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095424:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 2372us (18748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599633.454512:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1787599633.454535:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578054656 00000100:00100000:2.0:1787599633.454539:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578054656 00000100:00100000:2.0:1787599633.454558:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787599633.454565:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578054656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.454716:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055680 00000100:00100000:0.0:1787599633.454721:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055680 00000100:00100000:0.0:1787599633.454743:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055040 00000100:00100000:0.0:1787599633.454745:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055040 00000100:00100000:0.0:1787599633.454755:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055552 00000100:00100000:0.0:1787599633.454757:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055552 00000100:00100000:0.0:1787599633.454771:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599633.454778:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578055680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.454828:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874433578055680:12345-0@lo:400:kworker.0 Request processed in 51us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.454834:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599633.454848:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599633.454854:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578055040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.454879:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578055040:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.454885:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599633.454898:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599633.454906:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578055552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.454936:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578055552:12345-0@lo:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.454942:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787599633.454973:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599633.454980:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599633.454990:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599633.455028:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578054784:0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.455042:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578055296:0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.455053:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578055808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.455065:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578055424:0@lo:400:kworker.0 00010000:00080000:0.0:1787599633.455081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b34e51d180 x1874433578055936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599633.455092:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578055936:0@lo:400:kworker.0 00000100:00100000:2.0:1787599633.456054:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578054656:12345-0@lo:400:kworker.0 Request processed in 1484us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599633.456067:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787599633.457959:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578055040:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.457979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578055552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.457991:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578054656:0@lo:400:kworker.0 00010000:00080000:1.0:1787599633.458007:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243755f80 x1874433578055680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599633.458018:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1874433578055680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.458076:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578055168 00000100:00100000:1.0:1787599633.458082:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578055168 00000100:00100000:1.0:1787599633.458120:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578056064 00000100:00100000:1.0:1787599633.458123:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578056064 00000100:00100000:1.0:1787599633.458138:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599633.458148:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433578055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599633.458253:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874433578055168:12345-0@lo:400:kworker.0 Request processed in 107us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.458261:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599633.458279:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599633.458286:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578056064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599633.458310:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787599633.462973:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578056064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4295us (8279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599633.462991:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599633.463076:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578056064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599633.463089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578055168:0@lo:400:kworker.0 00000100:00100000:0.0:1787599633.469978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599633.475867:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095552 00000100:00100000:2.0:1787599633.475897:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095552 00000100:00100000:2.0:1787599633.476019:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:2.0:1787599633.476032:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+12:14915:x1874433559095552:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599633.476075:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599633.476095:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243758800/0x5d2988b0929d09ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfb1 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.476154:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243758800/0x5d2988b0929d09ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb1 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.476180:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243758800/0x5d2988b0929d09ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb1 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599633.476203:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758800, rc 0) 00000100:00100000:2.0:1787599633.476276:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:14915:x1874433559095552:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 247us (6325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599633.476284:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:1.0:1787599633.483333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599633.483417:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095680 00000100:00100000:0.0:1787599633.483429:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095680 00000100:00100000:0.0:1787599633.483490:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1787599633.483500:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:14915:x1874433559095680:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.483679:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:14915:x1874433559095680:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 179us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.483688:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1787599633.489064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599633.495462:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095808 00000100:00100000:0.0:1787599633.495480:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095808 00000100:00100000:0.0:1787599633.495628:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:0.0:1787599633.495639:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:14915:x1874433559095808:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599633.495858:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:14915:x1874433559095808:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 219us (6804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.495867:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00010000:00010000:0.0:1787599633.908006:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599633.961579:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578056192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599633.961651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599633.961726:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578056192 00000100:00100000:2.0:1787599633.961734:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578056192 00000100:00100000:2.0:1787599633.961782:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599633.961806:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578056192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599633.961849:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599633.961899:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578056192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599633.961908:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599633.961957:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578056192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599633.966985:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599633.967014:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578056320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599633.967086:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599633.970241:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578056320 00000100:00100000:0.0:1787599633.970256:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578056320 00000100:00100000:0.0:1787599633.970325:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599633.970336:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578056320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599633.970367:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599633.970464:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578056320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599633.970474:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599633.973778:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578056320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787599634.917933:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599635.398199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.398255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.398338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.398387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599635.398457:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096448 00000100:00100000:2.0:1787599635.398468:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096448 00000100:00100000:2.0:1787599635.398544:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1787599635.398555:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.398635:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.398642:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1787599635.398688:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599635.398947:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559095936 00000100:00100000:1.0:1787599635.398953:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559095936 00000100:00100000:1.0:1787599635.398996:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1787599635.399004:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559095936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599635.399033:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559095936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599635.399040:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1787599635.400952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.400976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599635.401044:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096960 00000100:00100000:2.0:1787599635.401053:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096960 00000100:00100000:2.0:1787599635.401107:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1787599635.401116:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.401168:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.401175:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:2.0:1787599635.401193:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599635.407502:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096192 00000100:00100000:0.0:1787599635.407520:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096192 00000100:00100000:0.0:1787599635.407612:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096704 00000100:00100000:0.0:1787599635.407615:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096704 00000100:00100000:0.0:1787599635.407666:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1787599635.407676:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599635.407757:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (9502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599635.407765:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1787599635.407784:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1787599635.407808:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599635.407847:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (9459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599635.407853:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00080000:2.0:1787599635.408278:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599635.408676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.408704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.408725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599635.408745:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096064 00000100:00100000:3.0:1787599635.408751:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096064 00000100:00100000:3.0:1787599635.408782:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096576 00000100:00100000:3.0:1787599635.408784:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096576 00000100:00100000:2.0:1787599635.409604:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096320 00000100:00100000:2.0:1787599635.409611:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096320 00000100:00100000:2.0:1787599635.409663:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559096832 00000100:00100000:2.0:1787599635.409666:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559096832 00000100:00100000:2.0:1787599635.409702:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599635.409711:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.409768:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559096320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.409776:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599635.409822:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599635.409829:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.409850:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2405:x1874433559096832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.409856:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00080000:2.0:1787599635.409988:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599635.409992:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599635.410010:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599635.410018:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2405:x1874433559096064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.410049:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2405:x1874433559096064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (9072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.410054:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599635.410068:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1787599635.410074:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559096576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599635.410095:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559096576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599635.410100:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:0.0:1787599635.941257:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599636.342435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.342557:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097088 00000100:00100000:0.0:1787599636.342568:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097088 00000100:00100000:0.0:1787599636.342639:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599636.342660:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:15582:x1874433559097088:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599636.342681:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.342704:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c600/0x5d2988b0929d09b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfb8 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342927:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342943:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342956:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342974:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342981:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.342989:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343074:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343083:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343105:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.343137:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599636.343141:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599636.343178:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343188:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343194:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343200:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343274:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.343278:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343286:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343298:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:0.0:1787599636.343302:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.343307:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343312:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343338:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343344:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343349:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343354:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.343357:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343362:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343369:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96b3555d8800) 00010000:00010000:0.0:1787599636.343371:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.343374:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343379:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343411:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c600/0x5d2988b0929d09b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb8 expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343424:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb8 expref: 7 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.343441:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b3555d8d00) 00010000:00010000:0.0:1787599636.343444:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599636.343446:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3ca00, rc 0) 00000100:00100000:0.0:1787599636.347862:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:15582:x1874433559097088:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5188us (5422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.347877:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599636.357692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599636.357848:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097216 00000100:00100000:2.0:1787599636.357858:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097216 00000100:00100000:2.0:1787599636.357931:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599636.357942:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:15582:x1874433559097216:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787599636.358038:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:15582:x1874433559097216:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 97us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599636.358046:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599636.368739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.368877:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097472 00000100:00100000:0.0:1787599636.368891:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097472 00000100:00100000:0.0:1787599636.368969:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1787599636.368982:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:15582:x1874433559097472:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599636.369005:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.369029:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c600/0x5d2988b0929d09ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfbf expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369117:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369132:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369144:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369215:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369224:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369442:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369567:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d09e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369576:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d09e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369583:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d09e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.369593:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787599636.369751:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369759:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369766:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369773:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.369777:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369784:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369955:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b3555d8d00) 00010000:00010000:0.0:1787599636.369960:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.369970:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369977:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d09d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369992:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.369998:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.370004:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.370009:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.370013:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.370019:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.370027:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96b3555d8800) 00010000:00010000:0.0:1787599636.370029:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.370032:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.370038:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d09dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.374651:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c600/0x5d2988b0929d09ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfbf expref: 10 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.374678:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d09e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfbf expref: 9 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.374688:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b3555d8700) 00010000:00010000:1.0:1787599636.374692:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.374695:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3ce00, rc 0) 00000100:00100000:1.0:1787599636.374785:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15582:x1874433559097472:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5804us (6055us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787599636.376360:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1787599636.393404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.394453:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097600 00000100:00100000:1.0:1787599636.394468:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097600 00000100:00100000:1.0:1787599636.394535:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1787599636.394546:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15582:x1874433559097600:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787599636.394670:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15582:x1874433559097600:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 126us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599636.394693:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1787599636.401905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.402055:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097728 00000100:00100000:1.0:1787599636.402070:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097728 00000100:00100000:1.0:1787599636.402129:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1787599636.402141:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15582:x1874433559097728:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787599636.406959:0:17097:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4753us 00000100:00100000:3.0:1787599636.418449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.418831:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097856 00000100:00100000:1.0:1787599636.418843:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097856 00000100:00100000:1.0:1787599636.418909:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1787599636.418921:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15588:x1874433559097856:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599636.418942:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599636.418962:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d09f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfc6 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419029:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419043:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419055:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419071:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419078:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419103:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419150:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419157:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419163:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419168:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599636.419172:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419179:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419190:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:1.0:1787599636.419193:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.419197:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419202:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d09f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419211:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419216:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419228:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419233:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599636.419236:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419242:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419249:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b242159800) 00010000:00010000:1.0:1787599636.419251:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.419254:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419259:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d09ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419292:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d09f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfc6 expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419302:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:1.0:1787599636.419304:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.419307:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d09f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfc6 expref: 10 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.419316:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a000, rc 0) 00000100:00100000:1.0:1787599636.419382:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15588:x1874433559097856:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 462us (942us total) trans 0 rc 301/301 00000100:00100000:1.0:1787599636.419398:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1787599636.425738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.425827:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559097984 00000100:00100000:1.0:1787599636.425838:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559097984 00000100:00100000:1.0:1787599636.425902:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599636.425916:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15588:x1874433559097984:12345-192.168.202.1@tcp:700:lfs.0 00000100:00100000:1.0:1787599636.426030:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15588:x1874433559097984:12345-192.168.202.1@tcp:700:lfs.0 Request processed in 117us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599636.426039:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599636.427610:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15582:x1874433559097728:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 25461us (25706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599636.427623:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1787599636.433182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.433265:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098240 00000100:00100000:0.0:1787599636.433277:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098240 00000100:00100000:0.0:1787599636.433375:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599636.433387:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:15588:x1874433559098240:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:0.0:1787599636.433440:0:18087:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599636.433462:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d091f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf33 expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.433481:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:0.0:1787599636.433486:0:18087:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599636.433541:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.433554:0:18087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 5 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.433563:0:18087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.433593:0:18087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 5 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.433606:0:18087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 5 pid: 17098 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599636.433620:0:18087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18087:1874433578056448:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599636.433719:0:18087:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599636.438930:0:18087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18087:1874433578056448:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599636.438973:0:18087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599636.440001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.440135:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098368 00000100:00100000:0.0:1787599636.440145:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098368 00010000:00010000:0.0:1787599636.440188:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 6 pid: 17098 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599636.440229:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1787599636.440239:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2403:x1874433559098368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599636.440254:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599636.440261:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 6 pid: 17098 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440273:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 6 pid: 17098 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440296:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d095e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfa3 expref: 6 pid: 17098 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440313:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:0.0:1787599636.440317:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440326:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440332:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.440398:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599636.440465:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7a1775-f008-45c6-8360-bad6104f0230+5:2403:x1874433559098368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 226us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.440473:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:2.0:1787599636.441399:0:18087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.441412:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.441441:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.441453:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.441462:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443628:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443663:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443672:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599636.443688:0:18087:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029efedba reply state 0000000087caee8d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443699:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443706:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:3.0:1787599636.443779:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599636.443784:0:18087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787599636.443949:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787599636.443960:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443974:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443981:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.443987:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599636.443993:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.444001:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.444014:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b3778bcf00) 00010000:00010000:3.0:1787599636.444017:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599636.444021:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.444026:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0a06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599636.444044:0:18087:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029efedba reply state 0000000087caee8d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.444053:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.444059:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b342bf1e00) 00010000:00010000:3.0:1787599636.444061:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599636.444064:0:18087:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787599636.444286:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+10:15588:x1874433559098240:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 10895us (11109us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787599636.444301:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000040:00080000:0.0:1787599636.517519:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787599636.610568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599636.610695:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098496 00000100:00100000:2.0:1787599636.610705:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098496 00000100:00100000:2.0:1787599636.610777:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1787599636.611045:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+10:15596:x1874433559098496:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:2.0:1787599636.611079:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599636.611105:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfcd expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611200:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611214:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611226:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599636.611266:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599636.611269:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599636.611305:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611330:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfcd expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611350:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfcd expref: 11 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.611359:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:2.0:1787599636.611362:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599636.611366:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:2.0:1787599636.611423:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+11:15596:x1874433559098496:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 635us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599636.611430:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1787599636.644238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599636.644375:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098624 00000100:00100000:3.0:1787599636.644386:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098624 00000100:00100000:3.0:1787599636.644452:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1787599636.644463:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:15597:x1874433559098624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599636.644484:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599636.644504:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929d0a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfd4 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644567:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644581:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644593:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599636.644635:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787599636.644671:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599636.644692:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644718:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4400/0x5d2988b0929d0a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfd4 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644738:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfd4 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599636.644765:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:3.0:1787599636.644768:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599636.644772:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b2440e4c00, rc 0) 00000100:00100000:3.0:1787599636.644906:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:15597:x1874433559098624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 443us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599636.644913:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000040:00080000:3.0:1787599636.646226:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787599636.659718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.659918:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098752 00000100:00100000:1.0:1787599636.659929:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098752 00000100:00100000:1.0:1787599636.659994:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1787599636.660006:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:15597:x1874433559098752:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599636.660029:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599636.660049:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0a37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfdb expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660112:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660127:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660168:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660180:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660188:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660195:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660273:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660282:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660289:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599636.660329:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787599636.660333:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599636.660356:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660368:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660375:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660392:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660399:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599636.660404:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660412:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660424:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:1.0:1787599636.660427:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.660432:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660440:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660453:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660458:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660465:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660470:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599636.660473:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660488:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660496:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b342bf1e00) 00010000:00010000:1.0:1787599636.660499:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.660502:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660508:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0a45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660534:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfdb expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660546:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfdb expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.660553:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:1.0:1787599636.660555:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599636.660557:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ba00, rc 0) 00000100:00100000:1.0:1787599636.660630:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+7:15597:x1874433559098752:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 626us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599636.660648:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1787599636.666051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.666151:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559098880 00000100:00100000:0.0:1787599636.666170:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559098880 00000100:00100000:0.0:1787599636.666229:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1787599636.666241:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd7a1775-f008-45c6-8360-bad6104f0230+5:15597:x1874433559098880:12345-192.168.202.1@tcp:900:lfs.0 00000100:00100000:0.0:1787599636.666335:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd7a1775-f008-45c6-8360-bad6104f0230+5:15597:x1874433559098880:12345-192.168.202.1@tcp:900:lfs.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.666343:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1787599636.669932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.670293:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559099136 00000100:00100000:1.0:1787599636.670304:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559099136 00000100:00100000:1.0:1787599636.670369:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1787599636.670380:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+7:15597:x1874433559099136:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1787599636.670403:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599636.670438:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfe2 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599636.670542:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787599636.670662:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0a53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfe2 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.670677:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:1.0:1787599636.670680:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599636.670685:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfe2 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.670696:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54b000, rc 0) 00000100:00100000:1.0:1787599636.670769:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+8:15597:x1874433559099136:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 391us (847us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787599636.670775:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1787599636.674269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599636.674465:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559099392 00000100:00100000:2.0:1787599636.674491:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559099392 00000100:00100000:2.0:1787599636.674553:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1787599636.674564:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+8:15597:x1874433559099392:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1787599636.674620:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599636.674661:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0a4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfdb expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.674683:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:2.0:1787599636.674688:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599636.674717:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.674733:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.674743:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599636.675016:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b9aef19 reply state 000000007ff740db transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.675029:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599636.675036:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:2.0:1787599636.675038:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787599636.675041:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787599636.675049:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787599636.675129:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+9:15597:x1874433559099392:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 566us (871us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787599636.675136:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1787599636.679173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.679266:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559099648 00000100:00100000:0.0:1787599636.679277:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559099648 00000100:00100000:0.0:1787599636.679336:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1787599636.679347:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd7a1775-f008-45c6-8360-bad6104f0230+9:15597:x1874433559099648:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599636.679581:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd7a1775-f008-45c6-8360-bad6104f0230+10:15597:x1874433559099648:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 235us (431us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787599636.679589:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1787599636.682537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.682647:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559099904 00000100:00100000:0.0:1787599636.682658:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559099904 00000100:00100000:0.0:1787599636.682722:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1787599636.682733:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+10:15597:x1874433559099904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599636.682758:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.682782:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbfe9 expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682900:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682927:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682938:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682949:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682955:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.682961:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.683058:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787599636.683127:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683134:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683140:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683146:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.683150:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683156:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683181:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:0.0:1787599636.683184:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.683189:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683195:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683208:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683213:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683219:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683224:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.683226:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683230:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683236:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b342bf1e00) 00010000:00010000:0.0:1787599636.683238:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.683241:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683246:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683285:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0a68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfe9 expref: 12 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683295:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:0.0:1787599636.683298:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599636.683301:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfe9 expref: 12 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.683309:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3da00, rc 0) 00000100:00100000:0.0:1787599636.683376:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd7a1775-f008-45c6-8360-bad6104f0230+11:15597:x1874433559099904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 644us (849us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787599636.683384:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1787599636.687002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.687136:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100032 00000100:00100000:0.0:1787599636.687147:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100032 00000100:00100000:0.0:1787599636.687259:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1787599636.687273:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+11:15597:x1874433559100032:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599636.687300:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.687322:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0a84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbff0 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687415:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687430:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687442:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.687482:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599636.687485:0:17099:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599636.687503:0:17099:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687528:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0a84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 13 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687545:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.687554:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:0.0:1787599636.687557:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599636.687560:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3de00, rc 0) 00000100:00100000:0.0:1787599636.687628:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+12:15597:x1874433559100032:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 356us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.687635:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1787599636.690961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.691078:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100160 00000100:00100000:1.0:1787599636.691090:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100160 00000100:00100000:1.0:1787599636.691146:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1787599636.691164:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd7a1775-f008-45c6-8360-bad6104f0230+12:15597:x1874433559100160:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:3.0:1787599636.695088:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd7a1775-f008-45c6-8360-bad6104f0230+12:15597:x1874433559100160:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 3920us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599636.695104:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1787599636.702412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599636.702512:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100416 00000100:00100000:3.0:1787599636.702524:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100416 00000100:00100000:3.0:1787599636.702592:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599636.702602:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379d68050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd7a1775-f008-45c6-8360-bad6104f0230+12:15597:x1874433559100416:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1787599636.702905:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379d68050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd7a1775-f008-45c6-8360-bad6104f0230+13:15597:x1874433559100416:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 304us (507us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787599636.702913:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599636.775181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.775336:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100544 00000100:00100000:0.0:1787599636.775348:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100544 00000100:00100000:0.0:1787599636.775412:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1787599636.775425:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+11:15603:x1874433559100544:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599636.775448:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.775471:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbff7 expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775536:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775568:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775580:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775593:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775600:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775607:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775706:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775715:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775722:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.775756:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599636.775760:0:18087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599636.775863:0:18087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775876:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775891:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775898:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775904:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.775909:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775916:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775928:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:0.0:1787599636.775931:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.775936:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775942:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775955:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775960:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775966:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775971:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599636.775978:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775984:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.775991:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b342bf1e00) 00010000:00010000:0.0:1787599636.775994:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599636.775997:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.776003:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0aa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.776030:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff7 expref: 13 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.776043:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff7 expref: 12 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.776051:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:0.0:1787599636.776053:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787599636.776055:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c200, rc 0) 00000100:00100000:0.0:1787599636.776118:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+12:15603:x1874433559100544:12345-192.168.202.1@tcp:101:bash.0 Request processed in 695us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.776125:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1787599636.781346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599636.781459:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100672 00000100:00100000:2.0:1787599636.781470:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100672 00000100:00100000:2.0:1787599636.781530:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599636.781541:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15603:x1874433559100672:12345-192.168.202.1@tcp:900:bash.0 00000100:00100000:2.0:1787599636.781613:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15603:x1874433559100672:12345-192.168.202.1@tcp:900:bash.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599636.781621:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599636.784028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.784135:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559100928 00000100:00100000:1.0:1787599636.784147:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559100928 00000100:00100000:1.0:1787599636.784208:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1787599636.784218:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+12:15603:x1874433559100928:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1787599636.784248:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599636.784269:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0aae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adbffe expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.784381:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.784399:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.784407:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.784443:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 12 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.784457:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 12 pid: 17099 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599636.784471:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578056576:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599636.784568:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3438f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599636.788104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599636.788226:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578056576:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599636.788256:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599636.789103:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559101056 00000100:00100000:0.0:1787599636.789112:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559101056 00010000:00010000:0.0:1787599636.789151:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 13 pid: 17099 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599636.789306:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1787599636.789317:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd7a1775-f008-45c6-8360-bad6104f0230+13:2404:x1874433559101056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599636.789331:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599636.789338:0:17853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 13 pid: 17099 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789351:0:17853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 13 pid: 17099 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789371:0:17853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0a8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff0 expref: 13 pid: 17099 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789385:0:17853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:0.0:1787599636.789390:0:17853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789399:0:17853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789406:0:17853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.789437:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599636.789496:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd7a1775-f008-45c6-8360-bad6104f0230+12:2404:x1874433559101056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 181us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.789504:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00010000:00010000:1.0:1787599636.789556:0:17097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.789563:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.789585:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.789600:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.789608:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790141:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790152:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790868:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599636.790883:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787599636.790915:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790922:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790930:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790936:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ba00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599636.790941:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790949:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790975:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:1.0:1787599636.790978:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599636.790983:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.790988:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0ab5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599636.791001:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc193ee2 reply state 00000000c0b6237b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.791012:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.791018:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96b242159800) 00010000:00010000:1.0:1787599636.791020:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599636.791023:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599636.791061:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0aae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.791076:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 14 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599636.791084:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599636.791086:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787599636.791088:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a800, rc 0) 00000100:00100000:1.0:1787599636.795299:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:15603:x1874433559100928:12345-192.168.202.1@tcp:101:bash.0 Request processed in 11069us (11269us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787599636.795434:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1787599636.821060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.821192:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559101184 00000100:00100000:0.0:1787599636.821227:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559101184 00000100:00100000:0.0:1787599636.821292:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1787599636.821302:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:15603:x1874433559101184:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599636.821341:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.821364:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0ad1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc005 expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821433:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821449:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821461:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.821518:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787599636.821523:0:18087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599636.821543:0:18087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821554:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821578:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0ad1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 17 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821597:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 16 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.821605:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599636.821614:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599636.821618:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d200, rc 0) 00000100:00100000:0.0:1787599636.821695:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:15603:x1874433559101184:12345-192.168.202.1@tcp:101:bash.0 Request processed in 395us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599636.821703:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1787599636.825604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599636.825766:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559101440 00000100:00100000:3.0:1787599636.825777:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559101440 00000100:00100000:3.0:1787599636.826788:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1787599636.826837:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:15603:x1874433559101440:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:3.0:1787599636.827174:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+17:15603:x1874433559101440:12345-192.168.202.1@tcp:35:bash.0 Request processed in 343us (1579us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787599636.834426:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00010000:00010000:0.0:1787599636.965044:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599636.978117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599636.979167:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559101696 00000100:00100000:0.0:1787599636.979183:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559101696 00000100:00100000:0.0:1787599636.979265:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1787599636.979278:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+17:15613:x1874433559101696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599636.979305:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599636.979327:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc00c expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599636.979426:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787599636.979534:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0adf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc00c expref: 19 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.979549:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:0.0:1787599636.979552:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599636.979558:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc00c expref: 19 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599636.979573:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3de00, rc 0) 00000100:00100000:0.0:1787599636.979677:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+18:15613:x1874433559101696:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 402us (1571us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787599636.979685:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1787599636.995955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599636.996065:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559101952 00000100:00100000:1.0:1787599636.996077:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559101952 00000100:00100000:1.0:1787599636.996144:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1787599636.996155:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+18:15613:x1874433559101952:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599636.996397:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15613:x1874433559101952:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 242us (452us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787599636.996405:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599637.067880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.068020:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559102208 00000100:00100000:0.0:1787599637.068047:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559102208 00000100:00100000:0.0:1787599637.068133:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1787599637.068145:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15616:x1874433559102208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599637.068181:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.068203:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0aed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc013 expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.068316:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0af4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.068332:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0af4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.068346:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0af4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599637.068357:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599637.068473:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0aed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc013 expref: 22 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.068491:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0af4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc013 expref: 21 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.068501:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.068504:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599637.068508:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d800, rc 0) 00000100:00100000:0.0:1787599637.068585:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:15616:x1874433559102208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 441us (714us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787599637.068592:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00080000:2.0:1787599637.069605:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599637.072602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.077008:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559102336 00000100:00100000:0.0:1787599637.077027:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559102336 00000100:00100000:0.0:1787599637.077119:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1787599637.077131:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:15616:x1874433559102336:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1787599637.077213:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077230:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077241:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077277:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077283:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077289:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077295:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.077299:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077306:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077318:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.077321:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599637.077340:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.077346:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.077434:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:15616:x1874433559102336:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 305us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.077443:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1787599637.084307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599637.084409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.084497:0:20126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559102720 00000100:00100000:0.0:1787599637.084509:0:20126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559102720 00000100:00100000:0.0:1787599637.084592:0:20126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1787599637.084607:0:20126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:2404:x1874433559102720:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599637.084625:0:20126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599637.084687:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0af4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc013 expref: 21 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.084710:0:20126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.084715:0:20126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599637.085204:0:20126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61197e0d-f8b1-498d-a559-d8255f02ecf0+20:2404:x1874433559102720:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 598us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.085214:0:20126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599637.085374:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559102592 00000100:00100000:1.0:1787599637.085381:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559102592 00000100:00100000:1.0:1787599637.085454:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1787599637.085462:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+20:15616:x1874433559102592:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599637.085659:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:15616:x1874433559102592:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 197us (1365us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787599637.085666:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599637.325143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.325316:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559102976 00000100:00100000:0.0:1787599637.325327:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559102976 00000100:00100000:0.0:1787599637.325385:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1787599637.325395:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+21:15647:x1874433559102976:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1787599637.325419:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.325443:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc01a expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.325570:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.325584:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.325596:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599637.325607:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599637.325746:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc01a expref: 24 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.325763:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc01a expref: 23 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.325773:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.325776:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599637.325780:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c800, rc 0) 00000100:00100000:0.0:1787599637.325885:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:15647:x1874433559102976:12345-192.168.202.1@tcp:101:cat.0 Request processed in 491us (755us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787599637.325892:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1787599637.331611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.331731:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559103104 00000100:00100000:1.0:1787599637.331743:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559103104 00000100:00100000:1.0:1787599637.331863:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1787599637.331876:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:2404:x1874433559103104:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599637.331892:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.331918:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0b10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc01a expref: 23 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.331939:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.331945:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599637.332245:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+22:2404:x1874433559103104:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 371us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.332271:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1787599637.336574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.337105:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559103360 00000100:00100000:3.0:1787599637.337116:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559103360 00000100:00100000:3.0:1787599637.337221:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1787599637.337233:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+22:15647:x1874433559103360:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:3.0:1787599637.337548:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:15647:x1874433559103360:12345-192.168.202.1@tcp:35:cat.0 Request processed in 317us (984us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787599637.337557:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1787599637.407517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.407598:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559103616 00000100:00100000:0.0:1787599637.407609:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559103616 00000100:00100000:0.0:1787599637.407687:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1787599637.407700:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:15653:x1874433559103616:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1787599637.407726:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.407763:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc021 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.407957:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.407970:0:17099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.407976:0:17099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 24 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.407980:0:17099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.408007:0:17099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 24 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.408017:0:17099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 24 pid: 18087 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.408026:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17099:1874433578056704:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599637.408378:0:17099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.408385:0:17099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 24 pid: 17097 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.408392:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17099:1874433578056832:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599637.408417:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347d93840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599637.411486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599637.411517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.411696:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559103744 00000100:00100000:1.0:1787599637.411696:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559103872 00000100:00100000:3.0:1787599637.411706:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559103744 00000100:00100000:1.0:1787599637.411706:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559103872 00010000:00010000:3.0:1787599637.411749:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 26 pid: 17097 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.411749:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 26 pid: 18087 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.411842:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17099:1874433578056832:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599637.411848:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1787599637.411854:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17099:1874433578056704:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599637.411858:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+26:2403:x1874433559103872:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599637.411873:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.411881:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 26 pid: 18087 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.411882:0:17099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.411895:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 26 pid: 18087 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599637.411942:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599637.411951:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+26:2403:x1874433559103744:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599637.411959:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599637.411964:0:17853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 26 pid: 17097 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.412295:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0ad8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc005 expref: 26 pid: 18087 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.412317:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.412321:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.412329:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.412336:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599637.412412:0:17853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 25 pid: 17097 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.412428:0:17853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a800/0x5d2988b0929d0ac3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbffe expref: 25 pid: 17097 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.412436:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+25:2403:x1874433559103872:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 579us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.412452:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:3.0:1787599637.412455:0:17853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:3.0:1787599637.412459:0:17853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.412466:0:17853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.412473:0:17853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.412547:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599637.412569:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:2403:x1874433559103744:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 620us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599637.412576:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:0.0:1787599637.412714:0:17099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.412722:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599637.412743:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599637.417948:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc021 expref: 24 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.417980:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc021 expref: 23 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.417990:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.417994:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787599637.417998:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3de00, rc 0) 00000100:00100000:0.0:1787599637.418076:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:15653:x1874433559103616:12345-192.168.202.1@tcp:101:dd.0 Request processed in 10377us (10566us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787599637.418085:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1787599637.423508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.423697:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104000 00000100:00100000:1.0:1787599637.423709:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104000 00000100:00100000:1.0:1787599637.423811:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1787599637.423820:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+23:15653:x1874433559104000:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1787599637.423841:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599637.423859:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc028 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.423884:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.423894:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.423901:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.424015:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 25 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.424034:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.424042:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.424045:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599637.424049:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ba00, rc 0) 00000100:00100000:1.0:1787599637.424116:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+24:15653:x1874433559104000:12345-192.168.202.1@tcp:101:dd.0 Request processed in 297us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.424130:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1787599637.427427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.427479:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104256 00000100:00100000:1.0:1787599637.427488:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104256 00000100:00100000:1.0:1787599637.427539:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1787599637.427549:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+24:15653:x1874433559104256:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:1.0:1787599637.427774:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.427810:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.427823:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599637.427866:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787599637.427889:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a763f175 reply state 0000000078189477 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.427902:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.427909:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.427912:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599637.427916:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599637.428020:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104256:12345-192.168.202.1@tcp:36:dd.0 Request processed in 471us (599us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787599637.428028:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000020:00080000:1.0:1787599637.428033:0:17097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787599637.430287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.430333:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104384 00000100:00100000:0.0:1787599637.430352:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104384 00000100:00100000:0.0:1787599637.430411:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1787599637.430435:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104384:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1787599637.430460:0:18087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.430481:0:18087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc02f expref: -99 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.430548:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc02f expref: 28 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.430562:0:18087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b48 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc02f expref: 28 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.430579:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.430583:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599637.430587:0:18087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c400, rc 0) 00000100:00100000:0.0:1787599637.430645:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15653:x1874433559104384:12345-192.168.202.1@tcp:101:dd.0 Request processed in 212us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.430652:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:2.0:1787599637.447278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.447482:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104640 00000100:00100000:1.0:1787599637.447495:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104640 00000100:00100000:1.0:1787599637.447583:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1787599637.447595:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15653:x1874433559104640:12345-192.168.202.1@tcp:103:dd.0 00010000:00010000:1.0:1787599637.447612:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.447647:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc02f expref: 28 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.447668:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.447674:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599637.447735:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104640:12345-192.168.202.1@tcp:103:dd.0 Request processed in 142us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.447742:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1787599637.451236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.451335:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104768 00000100:00100000:0.0:1787599637.451346:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104768 00000100:00100000:0.0:1787599637.451450:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1787599637.451462:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104768:12345-192.168.202.1@tcp:58:dd.0 00010000:00010000:0.0:1787599637.451570:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.451588:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.451600:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599637.453336:0:17099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599637.453664:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787599637.453780:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787599637.455452:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104768:12345-192.168.202.1@tcp:58:dd.0 Request processed in 3981us (4384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.455466:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1787599637.459269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.459411:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559104896 00000100:00100000:1.0:1787599637.459422:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559104896 00000100:00100000:1.0:1787599637.459488:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1787599637.459498:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+27:15653:x1874433559104896:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1787599637.459522:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599637.459545:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc036 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459607:0:17098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459619:0:17098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459652:0:17098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459685:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459700:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.459703:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599637.459707:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.459715:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54b000, rc 0) 00000100:00100000:1.0:1787599637.459783:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15653:x1874433559104896:12345-192.168.202.1@tcp:101:dd.0 Request processed in 285us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.461006:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000040:00080000:0.0:1787599637.541028:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599637.541039:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599637.541082:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787599637.541093:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787599637.541269:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17133:1874433578056960:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599637.541371:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599637.547476:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.549846:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17133:1874433578056960:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599637.550092:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559105024 00000100:00100000:1.0:1787599637.550102:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559105024 00000100:00100000:1.0:1787599637.550440:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1787599637.550453:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15654:x1874433559105024:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787599637.550492:0:17097:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787599637.550642:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15654:x1874433559105024:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 182us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.550651:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:2.0:1787599637.561989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.562043:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559105152 00000100:00100000:0.0:1787599637.562059:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559105152 00000100:00100000:0.0:1787599637.562132:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1787599637.562143:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15654:x1874433559105152:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.562220:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562237:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562249:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562314:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562337:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562362:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562387:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562396:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562401:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599637.562446:0:18087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787599637.562451:0:18087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599637.562465:0:18087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562475:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562482:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562489:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562495:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.562500:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562513:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562526:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b3555d8700) 00010000:00010000:0.0:1787599637.562529:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.562546:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562560:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0b5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562573:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562579:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562585:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562590:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.562593:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562599:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562606:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96b3555d8800) 00010000:00010000:0.0:1787599637.562609:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.562611:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562627:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0b64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562657:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562664:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562670:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562674:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.562677:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562682:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562689:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.562691:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.562694:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.562700:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.562785:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15654:x1874433559105152:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 643us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.563255:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1787599637.568373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.568550:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559105408 00000100:00100000:1.0:1787599637.568562:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559105408 00000100:00100000:1.0:1787599637.568645:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1787599637.568657:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+28:15654:x1874433559105408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599637.568680:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599637.568717:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0b72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc03d expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.568869:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.568884:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.568895:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599637.568907:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787599637.569094:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569104:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569112:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569118:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599637.569123:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569131:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569268:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:1.0:1787599637.569273:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787599637.569279:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569296:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569342:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0b72 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc03d expref: 30 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569353:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b3555d8700) 00010000:00010000:1.0:1787599637.569356:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599637.569504:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0b72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc03d expref: 30 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.569517:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a000, rc 0) 00000100:00100000:1.0:1787599637.569581:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+29:15654:x1874433559105408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 926us (1218us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787599637.569589:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1787599637.572200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.572283:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559105536 00000100:00100000:3.0:1787599637.572294:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559105536 00000100:00100000:3.0:1787599637.572653:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1787599637.572665:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+29:15654:x1874433559105536:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599637.572711:0:17098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599637.572881:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+29:15654:x1874433559105536:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 217us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599637.572888:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1787599637.583397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.583612:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559105792 00000100:00100000:1.0:1787599637.583626:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559105792 00000100:00100000:1.0:1787599637.583703:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1787599637.583714:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+29:15654:x1874433559105792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599637.583736:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599637.583758:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0b87 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc044 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599637.584197:0:17097:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1787599637.584204:0:17097:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787599637.584231:0:17097:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787599637.584425:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.584451:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.584464:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.584528:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0b87 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc044 expref: 32 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.584546:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc044 expref: 31 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.584554:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b242159d00) 00010000:00010000:1.0:1787599637.584556:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599637.584560:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54b200, rc 0) 00000100:00100000:1.0:1787599637.584640:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+31:15654:x1874433559105792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 918us (1243us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787599637.584648:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1787599637.597127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.597230:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106048 00000100:00100000:0.0:1787599637.597242:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106048 00000100:00100000:0.0:1787599637.597314:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1787599637.597325:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+31:15654:x1874433559106048:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.597404:0:18087:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599637.597441:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b200/0x5d2988b0929d0b8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc044 expref: 31 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597465:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b242159d00) 00010000:00010000:0.0:1787599637.597477:0:18087:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599637.597504:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597519:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597529:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597561:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597569:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597576:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597627:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597666:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597673:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597679:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.597684:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597691:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597701:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:0.0:1787599637.597703:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.597707:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597714:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d0b9c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597724:0:18087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597728:0:18087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597734:0:18087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597739:0:18087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.597748:0:18087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597754:0:18087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597763:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc961e8c1 (ffff96b3555d8800) 00010000:00010000:0.0:1787599637.597766:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.597769:0:18087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.597774:0:18087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c400/0x5d2988b0929d0ba3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc961e8c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.597929:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+30:15654:x1874433559106048:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 604us (816us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599637.597937:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1787599637.600866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.601594:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106176 00000100:00100000:0.0:1787599637.601607:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106176 00000100:00100000:0.0:1787599637.601682:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1787599637.601694:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+30:15654:x1874433559106176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.601717:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.601740:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0baa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc04b expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601772:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0bb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601783:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601840:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601953:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0baa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc04b expref: 32 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601974:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc04b expref: 31 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.601983:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.601986:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599637.601989:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c800, rc 0) 00000100:00100000:0.0:1787599637.602052:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+31:15654:x1874433559106176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 359us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.602061:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1787599637.610913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.610967:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106432 00000100:00100000:0.0:1787599637.610978:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106432 00000100:00100000:0.0:1787599637.611051:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1787599637.611062:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+31:15654:x1874433559106432:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.611154:0:18087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.611171:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.611183:0:18087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599637.611408:0:18087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787599637.611420:0:18087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584230627181ns, next at 585230624626ns, rc = 0 00000004:00010000:0.0:1787599637.611478:0:18087:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8636547 reply state 00000000c5d80e52 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.611491:0:18087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.611499:0:18087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.611502:0:18087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787599637.611505:0:18087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599637.611647:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+33:15654:x1874433559106432:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 585us (742us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787599637.611655:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1787599637.619237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.619274:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106560 00000100:00100000:0.0:1787599637.619286:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106560 00000100:00100000:0.0:1787599637.619366:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1787599637.619377:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+33:15654:x1874433559106560:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.619404:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.619426:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc052 expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.619489:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 34 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.619504:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 34 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.619740:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.619744:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599637.619747:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d400, rc 0) 00000100:00100000:0.0:1787599637.619833:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+34:15654:x1874433559106560:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 457us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.619840:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1787599637.626572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.626766:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106688 00000100:00100000:0.0:1787599637.626778:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106688 00000100:00100000:0.0:1787599637.626899:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1787599637.626911:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2403:x1874433559106688:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787599637.627153:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2403:x1874433559106688:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 244us (593us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787599637.627162:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:2.0:1787599637.627231:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599637.633758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.633962:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559106944 00000100:00100000:1.0:1787599637.633974:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559106944 00000100:00100000:1.0:1787599637.634041:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599637.634054:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+34:15654:x1874433559106944:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599637.634326:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+35:15654:x1874433559106944:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 274us (577us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787599637.634334:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599637.640170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.642541:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107200 00000100:00100000:0.0:1787599637.642557:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107200 00000100:00100000:0.0:1787599637.642651:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1787599637.642662:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+35:15654:x1874433559107200:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599637.643080:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+35:15654:x1874433559107200:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 417us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.643089:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1787599637.645899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.646053:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107328 00000100:00100000:1.0:1787599637.646065:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107328 00000100:00100000:1.0:1787599637.646124:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1787599637.646136:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+35:15654:x1874433559107328:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599637.646157:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599637.646179:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bc6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc059 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646253:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646270:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646282:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599637.646328:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599637.646358:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646384:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bc6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc059 expref: 37 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646401:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc059 expref: 36 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.646409:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:1.0:1787599637.646412:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787599637.646451:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a000, rc 0) 00000100:00100000:1.0:1787599637.646520:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+36:15654:x1874433559107328:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 385us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.646527:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1787599637.655727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.655850:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107456 00000100:00100000:0.0:1787599637.655860:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107456 00000100:00100000:0.0:1787599637.655923:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1787599637.655933:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2404:x1874433559107456:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.655971:0:18992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.655995:0:18992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc060 expref: -99 pid: 18992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599637.656022:0:18992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9b15, blocks: 0x0 00010000:00010000:0.0:1787599637.656042:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=584s v=(0 0) 00010000:00010000:0.0:1787599637.656047:0:18992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599637.656057:0:18992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 7 pid: 18992 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.656079:0:18992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 7 pid: 18992 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.656093:0:18992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c400, rc 0) 00000100:00100000:0.0:1787599637.656159:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2404:x1874433559107456:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 227us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.656166:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1787599637.660602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.660898:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107712 00000100:00100000:1.0:1787599637.660910:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107712 00000100:00100000:1.0:1787599637.660967:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1787599637.660978:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+36:15654:x1874433559107712:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599637.661129:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+36:15654:x1874433559107712:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 151us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.661138:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599637.663929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.664672:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107840 00000100:00100000:0.0:1787599637.664685:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107840 00000100:00100000:0.0:1787599637.664758:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1787599637.664769:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+36:15654:x1874433559107840:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787599637.670986:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787599637.671004:0:17078:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787599637.671067:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787599637.671211:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671225:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671244:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671251:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.671256:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671265:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671282:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96b342bf1e00) 00010000:00010000:0.0:1787599637.671285:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.671290:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671297:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0a0d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671321:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671328:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671334:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671340:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.671343:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671362:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671371:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:0.0:1787599637.671374:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.671377:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671383:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e5600/0x5d2988b0929d0a14 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671399:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671407:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671413:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671419:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.671423:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671429:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671438:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96b242159800) 00010000:00010000:0.0:1787599637.671440:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.671443:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671456:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a600/0x5d2988b0929d0abc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671473:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671480:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671486:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671491:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.671495:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671501:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671511:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.671514:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.671517:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.671524:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a400/0x5d2988b0929d0b41 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673167:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673184:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673192:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673198:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599637.673202:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673209:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673224:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:1.0:1787599637.673228:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787599637.673239:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.673247:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759a00/0x5d2988b0929d0a61 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673319:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673328:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673352:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673357:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.673360:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673367:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673376:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.673379:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787599637.673382:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.673388:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bb8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599637.673514:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599637.673533:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578057088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787599637.673543:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:15654:x1874433559107840:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 8759us (9610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.673553:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1787599637.673598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599637.673654:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578057088 00000100:00100000:3.0:1787599637.673663:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578057088 00000100:00100000:3.0:1787599637.673718:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599637.674575:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34425d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578057088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787599637.674739:0:18606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787599637.674743:0:18606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787599637.674746:0:18606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787599637.674748:0:18606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787599637 -> 1787599637 00002000:00010000:3.0:1787599637.674750:0:18606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787599637.674838:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34425d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433578057088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1111us (1238us total) trans 8589934596 rc 0/0 00000004:00080000:1.0:1787599637.674934:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2440ece00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787599637.674942:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578057088:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787599637.677338:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599637.680881:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599637.681205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.681938:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559107968 00000100:00100000:0.0:1787599637.681950:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559107968 00000100:00100000:0.0:1787599637.681995:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599637.682005:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2403:x1874433559107968:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787599637.682125:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2403:x1874433559107968:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 121us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.682132:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599637.686300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.686680:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108224 00000100:00100000:1.0:1787599637.686690:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108224 00000100:00100000:1.0:1787599637.686761:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1787599637.686773:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:15654:x1874433559108224:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599637.686883:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.686915:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a000/0x5d2988b0929d0bcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc059 expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.686936:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:1.0:1787599637.686942:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599637.686972:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.686986:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.687117:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599637.687319:0:17098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7288621 reply state 000000006c72ab17 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.687353:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.687359:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:1.0:1787599637.687362:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787599637.687364:0:17098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599637.687526:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:15654:x1874433559108224:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 753us (1234us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787599637.687535:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1787599637.695468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.695583:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108352 00000100:00100000:0.0:1787599637.695594:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108352 00000100:00100000:0.0:1787599637.695663:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1787599637.695674:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:15654:x1874433559108352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.695694:0:18604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599637.695713:0:18604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc067 expref: -99 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.695746:0:18604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 8 pid: 18992 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.695755:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599637.695760:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599637.695765:0:18604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.695851:0:18604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 8 pid: 18992 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.695866:0:18604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 8 pid: 18992 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.695879:0:18604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18604:1874433578057216:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599637.695997:0:18604:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599637.700767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.703107:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108480 00000100:00100000:1.0:1787599637.703124:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108480 00010000:00010000:1.0:1787599637.703190:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 9 pid: 18992 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.703242:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599637.703252:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:2403:x1874433559108480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599637.703269:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.703292:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 9 pid: 18992 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.703308:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 9 pid: 18992 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.703332:0:17085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599637.703337:0:17085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599637.703344:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.703369:0:17085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.703410:0:17085:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.703426:0:17085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17085:1874433578057344:192.168.202.1@tcp:105: 00000100:00100000:1.0:1787599637.703524:0:17085:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18900 going to sleep for 11 seconds 00010000:00010000:0.0:1787599637.704545:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0bd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc060 expref: 9 pid: 18992 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.704578:0:18604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18604:1874433578057216:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599637.704607:0:18604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.704620:0:18604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3da00, rc 0) 00000100:00100000:0.0:1787599637.704690:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+8:15654:x1874433559108352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 9018us (9232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.704700:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1787599637.710509:0:17085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17085:1874433578057344:192.168.202.1@tcp:105: 00010000:00010000:1.0:1787599637.710538:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599637.710599:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2403:x1874433559108480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 7347us (9845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.710611:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599637.712460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.712545:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108608 00000100:00100000:0.0:1787599637.712555:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108608 00000100:00100000:0.0:1787599637.712612:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1787599637.712623:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2403:x1874433559108608:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787599637.712772:0:18992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787599637.712776:0:18992:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787599637 00002000:00010000:0.0:1787599637.712779:0:18992:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787599636 00002000:00010000:0.0:1787599637.712782:0:18992:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787599637 -> 1787599637 00002000:00010000:0.0:1787599637.712784:0:18992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787599637.712881:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+8:2403:x1874433559108608:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 259us (428us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787599637.712889:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1787599637.716544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.716822:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108736 00000100:00100000:0.0:1787599637.716833:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108736 00000100:00100000:0.0:1787599637.716894:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599637.716905:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+8:2404:x1874433559108736:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787599637.716961:0:18606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.716982:0:18606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.717096:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599637.717100:0:18606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599637.717104:0:18606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.717136:0:18606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.717156:0:18606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.717171:0:18606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18606:1874433578057472:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599637.717363:0:18606:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242390b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599637.721556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.722531:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559108864 00000100:00100000:1.0:1787599637.722545:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559108864 00010000:00010000:1.0:1787599637.722595:0:17853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.722658:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599637.722670:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:2404:x1874433559108864:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599637.722686:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599637.722714:0:17853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.722747:0:17853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 9 pid: 18604 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.722778:0:17853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599637.722783:0:17853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599637.722790:0:17853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.722852:0:17853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.722880:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599637.722951:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+9:2404:x1874433559108864:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 282us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599637.722959:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:0.0:1787599637.725898:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b325287/0x5d2988b0929d0be2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc067 expref: 8 pid: 18604 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.725926:0:18606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18606:1874433578057472:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599637.725952:0:18606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726000:0:18606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726009:0:18606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726042:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726050:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726058:0:18606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726066:0:18606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599637.726070:0:18606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726080:0:18606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726100:0:18606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.726123:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d0be9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.726477:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+7:2404:x1874433559108736:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 9570us (9940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.726489:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1787599637.732245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599637.732312:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109120 00000100:00100000:1.0:1787599637.732323:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109120 00000100:00100000:1.0:1787599637.732754:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1787599637.732767:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:15654:x1874433559109120:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787599637.732894:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.732914:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.732923:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.732985:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.733010:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 16 pid: 17098 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.733027:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578057600:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599637.733134:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599637.738450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599637.738488:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578057600:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599637.738524:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.738569:0:20126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109248 00000100:00100000:0.0:1787599637.738578:0:20126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109248 00010000:00010000:0.0:1787599637.738621:0:20126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 17 pid: 17098 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.738691:0:20126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1787599637.738703:0:20126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61197e0d-f8b1-498d-a559-d8255f02ecf0+17:2403:x1874433559109248:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599637.738720:0:20126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599637.738728:0:20126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 17 pid: 17098 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738740:0:20126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 17 pid: 17098 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738764:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ba00/0x5d2988b0929d0b3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc028 expref: 17 pid: 17098 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738781:0:20126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.738845:0:20126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738871:0:20126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738880:0:20126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738888:0:20126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.738915:0:20126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599637.738942:0:17097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.738960:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.738974:0:20126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:2403:x1874433559109248:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 273us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.738982:0:20126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:2.0:1787599637.739182:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.739195:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.739202:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.739232:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.739247:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599637.739261:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578057728:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599637.739319:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344b590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599637.741725:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578057728:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599637.741752:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599637.746473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.747348:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109376 00000100:00100000:3.0:1787599637.747361:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109376 00010000:00010000:3.0:1787599637.747401:0:17085:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599637.747438:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1787599637.747448:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+17:2403:x1874433559109376:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599637.747465:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599637.747472:0:17085:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747502:0:17085:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747520:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d0bbf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc052 expref: 17 pid: 17099 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747533:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:3.0:1787599637.747539:0:17085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747547:0:17085:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747554:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599637.747644:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599637.747701:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+16:2403:x1874433559109376:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 253us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599637.747710:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:2.0:1787599637.750733:0:17097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.750751:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599637.751102:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787599637.751358:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787599637.751385:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787599637.751457:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17097:1874433578057856:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599637.751514:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599637.751552:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b344b599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599637.751582:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578057856 00000100:00100000:0.0:1787599637.751590:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578057856 00000100:00100000:0.0:1787599637.751651:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599637.751662:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17097:x1874433578057856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787599637.751761:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17097:x1874433578057856:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.751769:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599637.751876:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17097:1874433578057856:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787599637.752107:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787599637.752342:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17097:1874433578057984:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787599637.752398:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599637.752468:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b242d18000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599637.752582:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578057984 00000100:00100000:0.0:1787599637.752589:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578057984 00000100:00100000:1.0:1787599637.752714:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599637.752723:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17097:x1874433578057984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787599637.752927:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17097:x1874433578057984:12345-0@lo:1000:mdt00_000.0 Request processed in 205us (528us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787599637.752935:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599637.753039:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17097:1874433578057984:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787599637.753076:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753087:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753106:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753111:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.753116:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753124:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753209:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.753213:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599637.753219:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753226:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759600/0x5d2988b0929d0bf7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753263:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753270:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753275:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753280:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.753283:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753300:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753310:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.753312:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599637.753320:0:17097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753331:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753339:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.753392:0:17097:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.753404:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578058112:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599637.753521:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b38130bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599637.757968:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17097:1874433578058112:192.168.202.1@tcp:105: 00010000:00010000:0.0:1787599637.758077:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758089:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d800/0x5d2988b0929d0b4f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758125:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758215:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758226:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758238:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758245:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758250:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758256:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.758259:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758266:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758276:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.758279:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599637.758282:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758288:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d0bfe lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758297:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758310:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758315:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758320:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599637.758322:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758327:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758336:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:0.0:1787599637.758338:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599637.758341:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.758347:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54a200/0x5d2988b0929d0bf0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599637.758558:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15654:x1874433559109120:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 25791us (26320us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787599637.758568:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00080000:0.0:1787599637.758574:0:17097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787599637.758715:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787599637.758720:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599637.758735:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787599637.758742:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787599637.760397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.760474:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109504 00000100:00100000:0.0:1787599637.760483:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109504 00000100:00100000:0.0:1787599637.760537:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1787599637.760547:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379d69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15653:x1874433559109504:12345-192.168.202.1@tcp:49:dd.0 00000100:00100000:0.0:1787599637.760706:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379d69450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15653:x1874433559109504:12345-192.168.202.1@tcp:49:dd.0 Request processed in 159us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599637.760715:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1787599637.763286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.763339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599637.763428:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109888 00000100:00100000:2.0:1787599637.763441:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109888 00000100:00100000:2.0:1787599637.763506:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599637.763517:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+19:15653:x1874433559109888:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1787599637.763541:0:17099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599637.763562:0:17099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929d0c05 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc06e expref: -99 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763600:0:17099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0c0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763614:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0c0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763625:0:17099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0c0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17099 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763767:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758000/0x5d2988b0929d0c05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc06e expref: 21 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763847:0:17099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0c0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc06e expref: 20 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599637.763857:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:2.0:1787599637.763860:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787599637.763864:0:17099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759e00, rc 0) 00000100:00100000:2.0:1787599637.763926:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+20:15653:x1874433559109888:12345-192.168.202.1@tcp:101:dd.0 Request processed in 411us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599637.763935:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1787599637.764146:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559109760 00000100:00100000:0.0:1787599637.764151:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559109760 00000100:00100000:0.0:1787599637.764193:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1787599637.764202:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+20:15654:x1874433559109760:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787599637.764445:0:17101:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787599637.764485:0:17101:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787599637.764513:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764524:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764532:0:17101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764540:0:17101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764547:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764553:0:17101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764570:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787599637.764625:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+22:15654:x1874433559109760:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 424us (1349us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787599637.764658:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000020:00080000:0.0:1787599637.764662:0:17101:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787599637.764680:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599637.764685:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764692:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599637.764695:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764702:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764713:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:0.0:1787599637.764715:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787599637.764719:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764724:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3dc00/0x5d2988b0929d0c13 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.764732:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599637.764734:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599637.764735:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599637.945155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599637.945201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599637.945912:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110144 00000100:00100000:0.0:1787599637.945924:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110144 00000100:00100000:0.0:1787599637.945996:0:18611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110016 00000100:00100000:0.0:1787599637.946000:0:18611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110016 00000100:00100000:0.0:1787599637.946022:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1787599637.946031:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+8:2406:x1874433559110144:12345-192.168.202.1@tcp:4:dd.0 00002000:00010000:0.0:1787599637.946102:0:18611:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c9b15, atime: 0x6a8c9b14, ctime: 0x6a8c9b15, blocks: 0x0 00010000:00010000:0.0:1787599637.946112:0:18611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.946130:0:18611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=584s v=(0 0) 00010000:00010000:0.0:1787599637.946134:0:18611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599637.946141:0:18611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599637.946167:0:18611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599637.989293:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599638.055726:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599638.055764:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578058240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599638.055926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599638.056460:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058240 00000100:00100000:2.0:1787599638.056471:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058240 00000100:00100000:2.0:1787599638.056546:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787599638.056644:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599638.056679:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578058240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599638.056715:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599638.057667:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578058240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1107us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599638.057678:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:00080000:1.0:1787599638.066070:0:19420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787599638.066103:0:19420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787599638.067076:0:18611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1787599638.067085:0:18611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1787599638.067102:0:18611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067116:0:18611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067124:0:18611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067255:0:18611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3dc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599638.067265:0:18611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067274:0:18611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067296:0:18611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067304:0:18611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008734daf1/0x5d2988b0929d0c1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599638.067550:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+6:2406:x1874433559110144:12345-192.168.202.1@tcp:4:dd.0 Request processed in 121514us (122418us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787599638.067572:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1787599638.067605:0:18611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1787599638.067617:0:18611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559110016:12345-192.168.202.1@tcp:4:dd.0 00002000:00010000:2.0:1787599638.067672:0:18611:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a8c9b15, atime: 0x6a8c9b14, ctime: 0x6a8c9b15, blocks: 0x1a68 00010000:00010000:2.0:1787599638.067680:0:18611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067692:0:18611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1787599638.067696:0:18611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599638.067710:0:18611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599638.067722:0:18611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599638.068423:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578058240:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787599638.182073:0:19420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1787599638.182748:0:18611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1787599638.182772:0:18611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.182998:0:18611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.183010:0:18611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.183018:0:18611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599638.183024:0:18611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.183034:0:18611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.183059:0:18611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599638.183069:0:18611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d0c21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599638.183321:0:18611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559110016:12345-192.168.202.1@tcp:4:dd.0 Request processed in 115700us (238111us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787599638.183338:0:18611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1787599638.565118:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599638.565154:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578058496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599638.565242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.565534:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599638.565559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578058624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599638.565596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.565652:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058496 00000100:00100000:1.0:1787599638.565660:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058496 00000100:00100000:1.0:1787599638.565720:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599638.565731:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578058496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599638.565768:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787599638.565848:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578058496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599638.565857:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599638.565937:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058624 00000100:00100000:3.0:1787599638.565942:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058624 00000100:00100000:3.0:1787599638.565994:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599638.566009:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578058624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599638.566024:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1787599638.566064:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578058624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599638.566070:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599638.566111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578058624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599638.566324:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578058496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599638.566560:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599638.566574:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578058368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599638.566608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599638.566701:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058368 00000100:00100000:2.0:1787599638.566705:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058368 00000100:00100000:2.0:1787599638.566741:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599638.566749:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578058368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599638.566760:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1787599638.566830:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578058368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599638.566837:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787599638.567145:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599638.567352:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787599638.567359:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96b2440ece00, transno 8589934596 00000004:00080000:0.0:1787599638.567378:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787599638.567403:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578058368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599638.568131:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578059008:0@lo:400:kworker.0 00000100:00100000:3.0:1787599638.568209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599638.568234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578059520:0@lo:400:kworker.0 00000100:00100000:3.0:1787599638.568256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599638.568276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787599638.568282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578059136:0@lo:400:kworker.0 00000100:00100000:3.0:1787599638.568301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599638.568315:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578059648:0@lo:400:kworker.0 00000100:00100000:3.0:1787599638.568335:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599638.568600:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059008 00000100:00100000:0.0:1787599638.568606:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059008 00000100:00100000:0.0:1787599638.568690:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599638.568700:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578059008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.568754:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578059008:12345-0@lo:400:kworker.0 Request processed in 56us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599638.568773:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599638.568861:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578059008:0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.568883:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059520 00000100:00100000:0.0:1787599638.568886:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059520 00000100:00100000:0.0:1787599638.568916:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059136 00000100:00100000:0.0:1787599638.568919:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059136 00000100:00100000:0.0:1787599638.568931:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059648 00000100:00100000:0.0:1787599638.568934:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059648 00000100:00100000:0.0:1787599638.568947:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787599638.568953:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.568992:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578059520:12345-0@lo:400:kworker.0 Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599638.568998:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787599638.569009:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599638.569015:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578059136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.569042:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578059136:12345-0@lo:400:kworker.0 Request processed in 28us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599638.569049:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599638.569060:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787599638.569067:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578059648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.569095:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578059648:12345-0@lo:400:kworker.0 Request processed in 29us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599638.569101:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787599638.569125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578059136:0@lo:400:kworker.0 00010000:00080000:0.0:1787599638.569154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243478700 x1874433578059648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599638.569172:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578059648:0@lo:400:kworker.0 00000100:00080000:1.0:1787599638.569492:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599638.569498:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599638.569512:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578058752:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569584:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578059264:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569638:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578059776:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569684:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599638.569690:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578058880:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578059392:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569771:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578059904:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599638.569869:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059776 00000100:00100000:1.0:1787599638.569875:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059776 00000100:00100000:1.0:1787599638.569908:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059392 00000100:00100000:1.0:1787599638.569912:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059392 00000100:00100000:1.0:1787599638.569923:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059904 00000100:00100000:1.0:1787599638.569926:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059904 00000100:00100000:1.0:1787599638.569941:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599638.569948:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578059776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.569987:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578059776:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599638.569994:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599638.570009:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599638.570015:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578059392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.570041:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578059392:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599638.570047:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599638.570058:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599638.570065:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578059904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.570090:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578059904:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599638.570096:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787599638.570109:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599638.570112:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599638.570122:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058880 00000100:00100000:1.0:1787599638.570126:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058880 00000100:00100000:0.0:1787599638.570481:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578059520:0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.570513:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578058752 00000100:00100000:0.0:1787599638.570517:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578058752 00000100:00100000:0.0:1787599638.570548:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787599638.570556:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3645:x1874433578058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.570592:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3645:x1874433578058752:12345-0@lo:400:kworker.0 Request processed in 37us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599638.570599:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787599638.570679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578059392:0@lo:400:kworker.0 00010000:00080000:0.0:1787599638.570690:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b243479880 x1874433578059904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599638.570698:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578059904:0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.570706:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578058752:0@lo:400:kworker.0 00000100:00100000:0.0:1787599638.570714:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578059776:0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.571085:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599638.571096:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578058880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599638.571157:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578058880:12345-0@lo:400:kworker.0 Request processed in 62us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599638.571455:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599638.571496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578058880:0@lo:400:kworker.0 00000100:00100000:2.0:1787599638.571705:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578059264 00000100:00100000:2.0:1787599638.571711:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578059264 00000100:00100000:2.0:1787599638.571758:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599638.571765:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578059264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599638.571850:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578059264:12345-0@lo:400:kworker.0 Request processed in 85us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599638.571856:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787599638.573129:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599638.574086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578059264:0@lo:400:kworker.0 00010000:00010000:0.0:1787599639.016920:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599639.078231:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599639.078256:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578060032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599639.078334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599639.078587:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060032 00000100:00100000:2.0:1787599639.078609:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060032 00000100:00100000:2.0:1787599639.078703:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599639.078713:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578060032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599639.078749:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599639.078823:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578060032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599639.078830:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599639.079464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578060032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599639.082100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599639.082137:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578060160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599639.082232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599639.082290:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060160 00000100:00100000:1.0:1787599639.082298:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060160 00000100:00100000:1.0:1787599639.082359:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599639.082370:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578060160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599639.082409:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599639.082477:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578060160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599639.082484:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599639.082528:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578060160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599640.039077:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599640.050534:0:20276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787599640.524774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599640.527155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599640.527211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599640.527258:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110528 00000100:00100000:3.0:1787599640.527273:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110528 00000100:00100000:1.0:1787599640.527278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599640.527301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599640.527330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599640.527354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599640.527370:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111040 00000100:00100000:3.0:1787599640.527374:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111040 00000100:00100000:3.0:1787599640.527397:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110400 00000100:00100000:3.0:1787599640.527399:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110400 00000100:00100000:1.0:1787599640.527404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599640.527415:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110912 00000100:00100000:3.0:1787599640.527425:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110912 00000100:00100000:3.0:1787599640.527446:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1787599640.527454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599640.527459:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:1.0:1787599640.527487:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599640.527492:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599640.527523:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110784 00000100:00100000:1.0:1787599640.527529:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110784 00000100:00100000:3.0:1787599640.527557:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 101us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599640.527563:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1787599640.527580:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1787599640.527584:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599640.527586:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111296 00000100:00100000:1.0:1787599640.527591:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111296 00000100:00100000:1.0:1787599640.527625:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110656 00000100:00100000:3.0:1787599640.527630:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599640.527631:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110656 00000100:00100000:3.0:1787599640.527641:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1787599640.527649:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111168 00000100:00100000:1.0:1787599640.527653:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111168 00000100:00100000:3.0:1787599640.527661:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1787599640.527671:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+22:2406:x1874433559110400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599640.527677:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599640.527689:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599640.527720:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+22:2406:x1874433559110400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599640.527731:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1787599640.527731:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599640.527742:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599640.527746:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1787599640.527757:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:2406:x1874433559110912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599640.527762:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599640.527771:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599640.527830:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+6:2406:x1874433559110912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599640.527837:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599640.527839:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1787599640.527927:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1787599640.527942:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599640.527949:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599640.527982:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559110656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599640.527988:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599640.528009:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1787599640.528015:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599640.528040:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559111168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599640.528045:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:1.0:1787599640.528059:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599640.528062:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599640.528137:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559110272 00000100:00100000:2.0:1787599640.528143:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559110272 00000100:00100000:2.0:1787599640.528183:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:2.0:1787599640.528191:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:2406:x1874433559110272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599640.528214:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10394c45-c749-48e8-b612-3d793d59d9ea+13:2406:x1874433559110272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599640.528220:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000040:00080000:3.0:1787599640.741714:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599641.061056:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42465 lines, 42465 kept, 0 dropped, 0 bad.